-- Logs begin at Mon 2022-02-28 17:57:02 UTC, end at Mon 2022-02-28 19:28:34 UTC. -- Feb 28 18:52:11.154893 dv-cinder-831187-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 28 18:52:11.163656 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 28 18:52:11.165647 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 28 18:52:11 2022] *** Feb 28 18:52:11.165647 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 28 18:52:11.165647 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 28 18:52:11.165647 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: nodename: dv-cinder-831187-1-iscsi Feb 28 18:52:11.165647 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: machine: x86_64 Feb 28 18:52:11.165647 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: clock source: unix Feb 28 18:52:11.165647 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: pcre jit disabled Feb 28 18:52:11.165647 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: detected number of CPU cores: 4 Feb 28 18:52:11.165647 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: current working directory: / Feb 28 18:52:11.165647 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: detected binary path: /usr/bin/uwsgi-core Feb 28 18:52:11.165647 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: your processes number limit is 47680 Feb 28 18:52:11.166262 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: your memory page size is 4096 bytes Feb 28 18:52:11.166262 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: detected max file descriptor number: 2048 Feb 28 18:52:11.166262 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: lock engine: pthread robust mutexes Feb 28 18:52:11.166262 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: thunder lock: enabled Feb 28 18:52:11.166262 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 28 18:52:11.166262 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 28 18:52:11.212220 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: Python main interpreter initialized at 0x55f3378c59c0 Feb 28 18:52:11.212220 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: python threads support enabled Feb 28 18:52:11.212220 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: your server socket listen backlog is limited to 100 connections Feb 28 18:52:11.212220 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: your mercy for graceful operations on workers is 90 seconds Feb 28 18:52:11.212667 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: mapped 403077 bytes (393 KB) for 2 cores Feb 28 18:52:11.212751 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: *** Operational MODE: preforking *** Feb 28 18:52:11.213041 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: *** uWSGI is running in multiple interpreter mode *** Feb 28 18:52:11.213041 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: spawned uWSGI master process (pid: 87059) Feb 28 18:52:11.213205 dv-cinder-831187-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 28 18:52:11.213786 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: spawned uWSGI worker 1 (pid: 87060, cores: 1) Feb 28 18:52:11.215067 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: spawned uWSGI worker 2 (pid: 87061, cores: 1) Feb 28 18:52:11.215067 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 28 18:52:15.283586 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 18:52:15.284332 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 18:52:15.284428 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 18:52:15.284812 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 18:52:15.284884 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 18:52:15.284950 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 18:52:15.285016 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 18:52:15.285090 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 18:52:15.285157 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 18:52:15.285228 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.285305 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 18:52:15.285547 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.285679 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.285844 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.286009 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.286164 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.286335 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.286492 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.286659 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.286802 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.287000 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.287168 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.287346 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.287446 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.287671 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.287771 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.288013 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.288113 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.288318 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.288413 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.288576 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.288671 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831187-1-iscsi {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.288893 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.288986 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.289219 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831187-1-iscsi {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.289314 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.289544 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.289630 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.289858 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.289950 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.290156 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.290256 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.290477 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.290562 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.290783 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.290868 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.291131 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.291304 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.291440 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.292442 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.292538 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.292632 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.292700 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.292765 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.292829 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.292893 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.292956 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.293043 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.293177 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.293267 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.293488 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.293638 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.293915 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.294088 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.294250 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.294340 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.294645 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.294764 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.294975 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831187-1-iscsi {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.295079 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.295319 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.295404 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.295644 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.295764 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831187-1-iscsi {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.295963 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.296050 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.296280 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.296377 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.296598 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.296695 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.296972 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.297057 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.297292 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.297391 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.297656 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.297758 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.297981 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.298067 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.298309 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.298413 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.298623 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.298720 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.298935 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.299023 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.299279 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.299371 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.299585 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.299673 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.299893 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.299996 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.300202 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.300290 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.300514 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.300613 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.300817 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.300912 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.301120 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.301214 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.301369 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.301464 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.301675 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.301769 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.301970 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.302062 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.302282 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.302381 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.302607 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.302700 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.302877 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.302964 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.303137 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.303264 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.303463 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.303551 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.303759 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.303855 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.304076 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.304168 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.304385 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.304477 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.304691 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.304790 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.304996 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.305083 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.305299 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.305386 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.305604 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.305699 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.305909 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.306047 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.306214 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.306307 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.306522 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.306626 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.306833 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.306926 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.307170 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.307262 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.307479 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.307654 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.307795 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.307906 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.308147 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.308239 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.308430 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.308519 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.308738 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.308853 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.309077 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.309163 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.309923 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.310022 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.310265 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.310352 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.310644 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.310730 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.310966 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.311054 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.311300 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.311390 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.311610 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.311704 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.311918 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.312007 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.312238 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.312328 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.312563 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.312658 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.312868 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.312955 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.313117 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.313204 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.313417 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.313511 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.313721 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.313814 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.314025 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.314110 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.314330 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.314427 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.314898 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.314989 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.315228 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.315319 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.315532 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.315632 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.315837 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.315925 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.316138 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.316230 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.316442 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.316535 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.316747 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.316835 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.317055 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.317140 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.317356 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.317481 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.317662 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.317750 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.317966 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.318058 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.318266 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.318353 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.318574 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.318658 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.318880 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.318972 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.319208 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.319295 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.319518 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.319615 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.319825 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.319912 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.320131 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.320224 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.320440 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.320525 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.320743 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.320834 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.321048 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.321135 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.321357 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.321442 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.321662 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.321748 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.321968 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.322056 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.322276 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.322370 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.322735 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.322837 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.322928 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.323010 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.323209 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.323302 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.323512 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.323601 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.323817 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.323905 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.324117 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.324202 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.324426 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.324513 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.324728 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.324830 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.325700 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.325798 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.326012 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.326109 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.326320 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.326416 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.326627 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.326714 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.326932 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.327027 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.327266 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.327356 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.327570 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.327671 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.327876 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.327970 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.328181 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.328268 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.328495 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.328580 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.328802 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.328902 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.329106 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.329193 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.329412 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.329504 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.329720 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.329832 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.330042 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 18:52:15.330129 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.330385 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.330482 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.330699 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.330793 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.331034 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.331154 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.331392 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.331478 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.331712 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.331824 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.332026 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.332125 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.332342 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.332437 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.332664 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.332749 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.332975 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.333061 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.333289 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.333389 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.333603 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.333696 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.333915 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.334008 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.334229 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.334323 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.334551 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.334643 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.334870 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.334956 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.335211 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.335319 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.335535 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.335621 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.335847 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.335933 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.336168 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.336276 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.336481 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.336569 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.336807 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.336923 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.337121 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.337228 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.337465 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.337553 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.337780 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.337866 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.338111 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.338206 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.338442 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.338530 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.338759 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.338845 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.339072 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.339173 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.339411 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.339499 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.339723 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.339810 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.340035 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.340122 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.340351 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.340500 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.340686 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.340763 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.341004 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.341093 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.341317 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.341413 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.341628 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.341724 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.341938 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.342026 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.342249 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.342336 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.342561 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.342651 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.342893 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.342989 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.343234 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.343326 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.343551 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.343651 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.343865 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.343953 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.344179 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.344274 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.344493 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.344593 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.344929 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.345029 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.345183 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.345308 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.345503 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.345603 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.345823 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.345909 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.346133 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.346220 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.346445 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.346541 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.346757 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.346844 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.347085 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.347204 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.347428 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.347528 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.347735 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.347821 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.348071 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.348158 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.348381 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.348468 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.348690 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.348779 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.349004 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.349095 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.349311 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.349399 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.349622 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.349710 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.349928 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.350013 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.350231 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.350318 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.350547 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.350633 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.350855 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.350941 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.351184 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.351277 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.351504 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.351589 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.351809 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.351904 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.352158 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.352296 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.352470 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.352683 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.352781 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.352998 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.353087 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.353313 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.353444 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.353627 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.353715 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.353951 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.354046 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.354266 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.354361 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.354581 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.354668 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.354902 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.354989 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.355260 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.355360 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.355572 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.355681 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.355898 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.356001 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.356273 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.356364 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.356677 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.356772 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.357058 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.357144 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.357373 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.357460 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.357693 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.357789 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.358007 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.358101 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.358310 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.358396 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.358630 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.358744 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.358934 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.359078 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.359265 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.359354 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.359571 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.359742 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.359875 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.359963 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.360181 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.360267 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.360490 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.360622 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.360795 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.360889 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.361100 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.361195 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.361405 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.361492 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.361707 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.361800 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.362014 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.362101 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.362338 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.362431 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.362653 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.362750 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.362966 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.363059 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.363316 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.363411 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.363637 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.363731 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.363947 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.364041 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.364251 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.364338 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.364554 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.364648 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.364859 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.364953 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.365175 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.365261 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.365476 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.365562 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.365785 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.365882 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.366089 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.366176 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.366395 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.366480 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.366708 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.366806 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.367033 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.367167 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.367364 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.367462 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.367679 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.367776 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.367993 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.368124 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.368299 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.368392 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.368613 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.368709 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.368924 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.369011 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.369227 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.369317 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.369531 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.369619 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.369836 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.369921 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.370146 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.370230 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.370453 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.370541 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.370762 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.370850 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.371066 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.371183 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.371398 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.371484 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.372213 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.372327 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.372570 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.372702 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.372885 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.372976 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.373195 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.373290 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.373513 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.373600 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.373830 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.373917 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.374145 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.374231 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.374463 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.374557 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.374768 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.374856 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.375090 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.375248 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.375402 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.375501 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.375718 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.375865 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.376068 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.376157 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.376379 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.376477 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.376680 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.376767 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.376985 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.377070 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.377316 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.377411 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.377620 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.377715 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.377927 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.378014 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.378245 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.378333 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.378554 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.378650 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.378865 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.378951 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.379200 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.379292 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.379511 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.379598 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.379821 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.379919 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.380131 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.380225 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.380437 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.380553 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.380752 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.380840 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.381058 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.381149 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.381372 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.381467 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.381678 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.381766 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.381990 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.382127 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.382296 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.382382 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.382607 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.382709 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.382917 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.383005 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.383246 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.383335 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.383555 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.383653 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.383869 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.383956 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.384190 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.384450 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.384766 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.384883 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.385085 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.385171 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.385404 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.385489 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.385721 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.385816 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.386039 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.386128 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.386361 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.386447 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.386684 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.386777 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.386996 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.387152 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.387457 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.388059 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.388265 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.388460 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.388575 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.388886 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.388985 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.389198 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.389295 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.389506 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.389594 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.389813 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.389909 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.390118 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.390261 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.390428 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.390517 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.390732 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.390819 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.391037 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.391152 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.391365 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.391465 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.391668 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.391764 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.391982 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.392078 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.392284 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.392371 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.392596 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.392683 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.392901 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.392988 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.393218 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.393303 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.393523 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.393615 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.393824 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.393919 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.394125 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.394219 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.394426 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.394513 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.394738 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.394824 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.395047 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.395239 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.395407 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.395507 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.395722 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.395809 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.396068 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.396166 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.396371 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.396469 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.396675 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.396762 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.396996 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.397082 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.397299 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.397396 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.397599 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.397696 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.397906 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.397994 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.398211 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.398299 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.398513 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.398617 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.398822 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.398910 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.399157 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.399249 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.399468 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.399565 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.399771 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.399859 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.400077 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.400164 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.400379 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.400473 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.400691 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.400777 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.400990 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.401076 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.401292 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.401388 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.401594 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.401689 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.401897 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.401983 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.402201 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.402352 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.402502 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.402590 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.402808 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.402900 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.403686 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.403825 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.404034 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.404152 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.404347 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.404435 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.404648 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.404735 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.404949 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.405037 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.405253 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.405338 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.405562 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.405651 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.405874 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.405960 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.406179 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.406272 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.406489 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.406577 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.406792 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.406885 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.407094 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.407256 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.407423 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.407519 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.407730 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.407822 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.408033 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.408129 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.408336 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.408425 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.408638 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.408724 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.408939 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.409035 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.409242 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.409328 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.409550 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.409636 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.409857 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.409951 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.410161 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.410249 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.410463 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.410559 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.410766 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.410865 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.411099 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.411246 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.411424 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.411512 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.411767 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.411862 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.412076 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.412163 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.412388 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.412473 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.412707 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.412799 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.413019 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.413106 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.413332 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.413418 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.413644 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.413770 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.413946 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.414032 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.414263 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.414349 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.414572 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.414670 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.414883 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.414969 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.415211 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.415301 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.415515 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.415604 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.415835 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.415922 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.416146 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.416241 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.416458 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.416547 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.416773 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.416859 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.417090 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.417185 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.417410 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.417496 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.417714 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.417800 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.418021 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.418121 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.418331 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.418419 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.418699 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.419355 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.419546 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.419685 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.419995 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.420192 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.420282 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.420502 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.420589 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.420815 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.420904 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.421126 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.421220 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.421435 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.421532 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.421745 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.421833 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.422056 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.422143 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.422365 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.422458 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.422670 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.422758 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.422981 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.423067 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.423320 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.423425 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.423626 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.423714 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.423935 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.424023 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.424238 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.424339 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.424548 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.424641 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.424849 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.424935 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.425159 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.425293 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.425479 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.425606 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.425797 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.425916 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.426241 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.426329 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.426552 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.426638 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.426865 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.426952 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.427199 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.427291 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.427515 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.427601 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.427821 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.427919 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.428138 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.428225 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.428457 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.428544 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.428767 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.428857 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.429129 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.429216 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.429441 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.429528 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.429745 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.429842 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.430055 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.430142 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.430380 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.430458 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.430685 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.430770 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.430985 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.431068 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.431341 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.431430 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.431652 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.431927 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.432021 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.432091 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.432257 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.432333 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.432595 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.432694 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.432888 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.432977 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.433213 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.433301 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.433637 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.433861 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.433950 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.434183 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.434287 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.434519 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.434846 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.434924 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.435231 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.435363 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.435556 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.435695 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.435885 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.436006 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.436211 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.436324 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.436542 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.436629 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.436855 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.436943 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.437176 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.437267 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.437492 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.437590 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.437822 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.437899 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.438225 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.438518 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.438811 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.438895 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.438966 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.439040 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.439240 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.439380 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.439451 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.439855 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.439996 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.440320 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.440395 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.440648 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.440724 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.440976 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.441071 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.441300 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.441387 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.441624 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.441711 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.441934 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.442023 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.442240 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.442372 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.442550 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.442662 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.442896 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.443092 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.443249 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.443345 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.443538 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.443626 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.443844 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.443920 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.444155 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.444231 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.444467 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.444555 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.444774 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.444850 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.445081 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.445163 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.445387 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.445472 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.445697 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.445788 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.446001 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.446087 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.446324 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.446426 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.446634 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.446933 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.447029 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.447281 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.447453 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.447606 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.447694 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.447913 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.448000 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.448226 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.448325 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.448534 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.448619 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.448837 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.448923 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.449143 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.449243 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.449448 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.449544 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.449758 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.449889 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.450139 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.450236 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.450451 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.450598 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.450780 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.450930 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.451162 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.451289 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.451473 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.451601 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.451790 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.451935 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.452128 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.452263 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.452461 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.452580 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.452781 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.452916 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.453103 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.453221 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.453433 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.453522 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.453742 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.453829 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.454048 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.454135 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.454362 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.454450 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.454670 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.454757 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.454978 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.455135 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.455293 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.455439 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.455607 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.455755 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.455906 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.456039 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.456208 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.456297 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.456512 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.456606 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.456815 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.456911 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.457132 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.457218 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.457436 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.457524 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.457738 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.457900 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.458040 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.458136 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.458341 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.458430 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.458646 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.458750 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.458973 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.459067 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.459315 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.459430 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.459639 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.459736 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.459958 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.460044 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.460282 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.460422 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.460592 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.460689 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.460915 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.461004 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.461232 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.461320 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.461548 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.461637 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.461864 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.461966 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.462179 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.462275 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.462492 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.462625 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.462809 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.462939 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.463136 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.463228 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.463456 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.463545 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.463769 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.463865 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.464081 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.464168 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.464396 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.464493 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.464713 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.464971 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.465280 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.465376 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.466195 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.466347 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.466517 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.466829 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.466967 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.467172 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.467264 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.467493 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.467600 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.467807 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.467896 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.468121 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.468212 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.468435 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.468523 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.468745 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.468834 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.469075 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.469166 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.469405 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.469494 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.469738 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.469836 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.470087 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.470185 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.470405 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.470494 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.470721 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.470807 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.471034 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.471164 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.471381 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.471474 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.471715 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.471812 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.472043 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.472132 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.472390 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.472484 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.472715 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.472805 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.473033 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.473145 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.473352 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.473453 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.473677 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.473766 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.473994 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.474081 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.474309 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.474406 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.474627 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.474722 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.474943 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.475031 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.475277 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.475438 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.475595 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.475685 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.475909 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.476007 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.476224 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.476313 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.476547 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.476635 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.476872 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.476961 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.477186 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.477276 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.477498 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.477587 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.477828 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.477915 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.478146 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.478366 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.478456 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.478690 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.478997 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.479086 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.479345 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.479435 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.479685 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.479785 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.480008 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.480104 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.480330 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.480424 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.480650 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.480744 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.480956 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.481060 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.481324 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.481907 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.482180 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.482267 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.482494 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.482592 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.482811 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.482899 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.483145 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.483236 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.483461 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.483587 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.483790 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.483887 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.484108 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.484204 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.484464 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.484576 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.484745 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.485057 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.485147 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.485428 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.485605 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.485725 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.485968 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.486069 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.486294 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.486394 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.486630 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.486719 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.486966 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.487055 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.487330 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.487419 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.487639 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.487736 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.487946 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.488035 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.488264 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.488365 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.488575 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.488662 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.488878 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.488965 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.489186 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.489374 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.489494 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.489591 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.489802 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.489889 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.490105 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.490201 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.490415 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.490503 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.490718 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.490808 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.491031 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.491195 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.491365 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.491453 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.491671 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.491759 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.491977 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.492079 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.492291 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.492380 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.492597 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.492732 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.492902 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.492994 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.493208 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.493347 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.493512 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.493592 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.493820 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.493914 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.494122 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.494209 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.494431 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.494526 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.494734 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.494832 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.495046 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.495158 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.495373 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.495462 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.495682 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.495780 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.495987 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.496083 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.496302 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.496391 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.496604 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.496731 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.497438 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.497575 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.497756 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.497858 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.498068 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.498157 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.498392 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.498479 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.498704 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.498798 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.499015 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.499104 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.499359 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.499610 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.499699 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.499937 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.500236 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.500505 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.500614 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.500840 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.501112 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.501208 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.501459 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.501547 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.501790 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.501886 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.502114 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.502202 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.502419 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.502506 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.502724 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.502820 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.503046 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.503156 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.503384 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.503473 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.503695 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.503784 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.504007 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.504096 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.504322 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.504416 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.504651 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.504753 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.504967 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.505061 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.505274 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.505364 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.505583 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.505725 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.505892 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.505983 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.506202 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.506299 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.506512 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.506611 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.506824 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.506919 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.507167 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.507267 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.507490 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.507598 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.507810 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.507905 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.508125 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.508218 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.508444 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.508574 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.508753 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.508862 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.509062 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.509164 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.509381 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.509472 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.509696 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.509785 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.510015 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.510106 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.510331 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.510428 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.510648 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.510736 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.510954 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.511044 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.511310 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.511413 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.511622 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.511711 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.512026 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.512170 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.512373 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.512487 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.513257 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.513710 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.513845 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.513948 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.514033 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.514122 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.514215 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.514298 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.514519 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.514617 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.514849 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.514938 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.515179 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.515273 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.515488 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.515592 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.515800 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.515899 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.516114 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.516202 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.516431 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.516521 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.516773 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.516860 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.517095 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.517191 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.517425 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.517515 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.517739 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.517828 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.518050 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.518140 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.518364 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.518455 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.518677 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.518767 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.518989 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.519078 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.519333 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.519425 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.519656 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.519746 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.519980 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.520150 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.520291 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.520380 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.520617 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.520706 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.520930 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.521027 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.521253 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.521342 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.521562 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.521652 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.521879 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.521976 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.522186 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.522331 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.522499 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.522601 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.522817 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.522928 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.523175 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.523318 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.523484 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.523574 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.523798 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.523897 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.524119 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.524209 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.524428 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.524517 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.524751 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.524842 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.525062 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.525149 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.525381 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.525476 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.525692 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.525783 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.526019 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.526118 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.526326 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.526431 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.526638 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.526729 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.526950 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.527054 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.527285 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.527376 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.527599 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.527690 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.527910 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.528542 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.528906 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.529326 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.529422 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.529506 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.529588 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.529669 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.529750 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.529839 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.530039 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.530130 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.530361 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.530459 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.530679 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.530778 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.530995 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.531094 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.531351 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.531441 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.531666 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.531756 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.531986 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.532088 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.532300 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.532389 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.532614 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.532704 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.532927 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.533016 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.533240 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.533327 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.533561 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.533699 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.533882 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.533975 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.534206 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.534306 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.534532 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.534622 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.534883 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.534983 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.535207 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.535318 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.535554 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.535643 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.535875 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.535971 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.536116 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 18:52:15.536213 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.536544 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 18:52:15.536794 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87061) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 18:52:15.573516 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_db.sqlalchemy.engines [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:52:15.574514 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG oslo_db.sqlalchemy.engines [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:52:15.822260 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.context [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e343478d-eb46-4c0e-957d-8f9025dbea36(cell1) {{(pid=87061) load_cells /opt/stack/nova/nova/context.py:464}} Feb 28 18:52:15.824435 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.context [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e343478d-eb46-4c0e-957d-8f9025dbea36(cell1) {{(pid=87060) load_cells /opt/stack/nova/nova/context.py:464}} Feb 28 18:52:15.826949 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG oslo_concurrency.lockutils [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:52:15.828626 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG oslo_concurrency.lockutils [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:52:15.829200 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:52:15.829433 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG oslo_concurrency.lockutils [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:52:15.830844 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:52:15.831422 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG oslo_concurrency.lockutils [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87061) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:52:15.831684 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:52:15.833728 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:52:15.857735 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG oslo_db.sqlalchemy.engines [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:52:15.868189 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_db.sqlalchemy.engines [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:52:15.870699 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_db.sqlalchemy.engines [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:52:15.873094 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG oslo_db.sqlalchemy.engines [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:52:15.904341 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG oslo_db.sqlalchemy.engines [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87061) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:52:15.905931 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_db.sqlalchemy.engines [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 18:52:16.163429 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO keyring.backend [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Loading KWallet Feb 28 18:52:16.182491 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO keyring.backend [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Loading KWallet Feb 28 18:52:16.269151 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO keyring.backend [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Loading SecretService Feb 28 18:52:16.272771 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 18:52:16.272771 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: from cryptography.utils import int_from_bytes Feb 28 18:52:16.273085 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 18:52:16.273085 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: from cryptography.utils import int_from_bytes Feb 28 18:52:16.273861 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO keyring.backend [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Loading Windows Feb 28 18:52:16.275740 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO keyring.backend [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Loading chainer Feb 28 18:52:16.276521 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO keyring.backend [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Loading macOS Feb 28 18:52:16.287628 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO keyring.backend [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Loading SecretService Feb 28 18:52:16.291134 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 18:52:16.291134 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: from cryptography.utils import int_from_bytes Feb 28 18:52:16.291454 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 18:52:16.291454 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: from cryptography.utils import int_from_bytes Feb 28 18:52:16.292162 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO keyring.backend [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Loading Windows Feb 28 18:52:16.294156 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO keyring.backend [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Loading chainer Feb 28 18:52:16.294944 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO keyring.backend [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Loading macOS Feb 28 18:52:16.530422 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: WARNING keystonemiddleware.auth_token [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 18:52:16.536976 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: WARNING keystonemiddleware.auth_token [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 18:52:16.547382 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: WARNING keystonemiddleware.auth_token [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 18:52:16.554108 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: WARNING keystonemiddleware.auth_token [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 18:52:16.759379 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: WARNING keystonemiddleware.auth_token [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 18:52:16.765246 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: WARNING keystonemiddleware.auth_token [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 18:52:16.770561 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3378c59c0 pid: 87061 (default app) Feb 28 18:52:16.772664 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:52:16.773776 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] 10.222.0.21 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001687 Feb 28 18:52:16.774193 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 788 bytes} [Mon Feb 28 18:52:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:52:16.781710 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: WARNING keystonemiddleware.auth_token [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 18:52:16.786815 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: WARNING keystonemiddleware.auth_token [None req-cc991c26-e669-484e-8085-1cb44b53e73f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 18:52:16.793109 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f3378c59c0 pid: 87060 (default app) Feb 28 18:53:41.957425 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:53:41.958447 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Feb 28 18:53:41.958853 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 2/2] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:53:42.532043 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-8b0a76dd-8c37-4255-bab4-26d0f232fc19 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:53:42.562659 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-8b0a76dd-8c37-4255-bab4-26d0f232fc19 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.595781 Feb 28 18:53:42.563705 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 1/3] 10.222.0.21 () {60 vars in 1291 bytes} [Mon Feb 28 18:53:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 18:53:44.780405 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:53:44.781382 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-5ea2feaf-2a0b-4041-83c9-9506eb14d931 None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Feb 28 18:53:44.781775 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 3/4] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:53:44.839376 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-717bc631-0bcb-437d-a9b6-b751e3a75e02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "name": "cirros256", "id": "c1", "disk": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:44.857681 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:53:44.857681 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: warnings.warn(msg) Feb 28 18:53:44.949732 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-717bc631-0bcb-437d-a9b6-b751e3a75e02 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.161838 Feb 28 18:53:44.950295 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 2/5] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 18:53:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 18:53:45.292036 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-23718626-2ad0-4702-bc84-039ce3eb6bdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:45.294368 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:53:45.294368 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: warnings.warn(msg) Feb 28 18:53:45.401072 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-23718626-2ad0-4702-bc84-039ce3eb6bdd admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.442335 Feb 28 18:53:45.401660 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 4/6] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Feb 28 18:53:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 18:53:47.560617 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-717bc631-0bcb-437d-a9b6-b751e3a75e02 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:53:47.561620 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-717bc631-0bcb-437d-a9b6-b751e3a75e02 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Feb 28 18:53:47.562266 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 3/7] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:53:47.668693 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-e49a3818-414b-4660-a482-0f7cbf909592 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:47.687004 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:53:47.687004 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: warnings.warn(msg) Feb 28 18:53:47.793724 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-e49a3818-414b-4660-a482-0f7cbf909592 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.225353 Feb 28 18:53:47.794225 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 5/8] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 18:53:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 18:53:47.805893 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-c589d74a-f9ac-4bdc-8d23-d6c7716025a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:47.807995 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:53:47.807995 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: warnings.warn(msg) Feb 28 18:53:47.913187 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-c589d74a-f9ac-4bdc-8d23-d6c7716025a0 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111052 Feb 28 18:53:47.913767 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 4/9] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Feb 28 18:53:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 18:53:50.073509 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-e49a3818-414b-4660-a482-0f7cbf909592 admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:53:50.074582 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-e49a3818-414b-4660-a482-0f7cbf909592 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Feb 28 18:53:50.074979 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 6/10] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:53:50.129858 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-d11ae4bf-820c-43c0-86f8-4b5ac82189e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:50.221841 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-d11ae4bf-820c-43c0-86f8-4b5ac82189e7 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140876 Feb 28 18:53:50.222391 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 5/11] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 18:53:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 18:53:50.234327 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-18f57e09-de33-4907-a129-9dae86d99e2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:50.304478 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-18f57e09-de33-4907-a129-9dae86d99e2f admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073875 Feb 28 18:53:50.305050 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 7/12] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Feb 28 18:53:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 18:53:52.461955 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-d11ae4bf-820c-43c0-86f8-4b5ac82189e7 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:53:52.463741 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-d11ae4bf-820c-43c0-86f8-4b5ac82189e7 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002170 Feb 28 18:53:52.464146 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 6/13] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:53:52.520276 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-be015e06-825a-4795-9c26-3f8f6b017795 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:52.614832 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-be015e06-825a-4795-9c26-3f8f6b017795 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144593 Feb 28 18:53:52.615408 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 8/14] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 18:53:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 18:53:52.627103 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-d3b06ef0-9215-48ec-99c3-627b19c69892 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:52.716697 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-d3b06ef0-9215-48ec-99c3-627b19c69892 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093162 Feb 28 18:53:52.717281 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 7/15] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Feb 28 18:53:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 18:53:54.891238 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-be015e06-825a-4795-9c26-3f8f6b017795 admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:53:54.892232 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-be015e06-825a-4795-9c26-3f8f6b017795 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Feb 28 18:53:54.892631 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 9/16] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:53:54.949448 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-52d95d61-87dc-40dc-9cbe-10596c99adbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "disk": 20, "name": "ds4G", "swap": 0, "id": "d4"}} {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:55.021334 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-52d95d61-87dc-40dc-9cbe-10596c99adbb admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.122608 Feb 28 18:53:55.021890 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 8/17] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 18:53:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 18:53:55.033717 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-5e53deb2-d050-42d5-a2f2-b54ae2acce48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:55.144178 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-5e53deb2-d050-42d5-a2f2-b54ae2acce48 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113978 Feb 28 18:53:55.144757 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 10/18] 10.222.0.21 () {64 vars in 1335 bytes} [Mon Feb 28 18:53:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 18:53:57.296569 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-52d95d61-87dc-40dc-9cbe-10596c99adbb admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:53:57.297619 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-52d95d61-87dc-40dc-9cbe-10596c99adbb admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Feb 28 18:53:57.298000 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 9/19] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:53:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:53:57.354722 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-18459c7d-3cb7-4e90-b308-673a97a8f613 admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:53:57.375407 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-18459c7d-3cb7-4e90-b308-673a97a8f613 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.071393 Feb 28 18:53:57.375924 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 11/20] 10.222.0.21 () {60 vars in 1291 bytes} [Mon Feb 28 18:53:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 18:53:59.594899 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-52d95d61-87dc-40dc-9cbe-10596c99adbb admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:53:59.595925 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-52d95d61-87dc-40dc-9cbe-10596c99adbb admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Feb 28 18:53:59.596337 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 10/21] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:53:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:53:59.653247 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-b13692e4-5e85-4176-930d-f4a626e4b7bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "disk": 1, "id": "1", "name": "m1.tiny"}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:59.738202 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-b13692e4-5e85-4176-930d-f4a626e4b7bf admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.135588 Feb 28 18:53:59.738734 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 12/22] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 18:53:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 18:53:59.750253 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-d2dcd4cb-4cd7-4aa1-99f5-cec7f0bd6484 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:53:59.852056 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-d2dcd4cb-4cd7-4aa1-99f5-cec7f0bd6484 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105500 Feb 28 18:53:59.852557 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 11/23] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Feb 28 18:53:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 18:54:02.015435 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-b13692e4-5e85-4176-930d-f4a626e4b7bf admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:54:02.016426 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-b13692e4-5e85-4176-930d-f4a626e4b7bf admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Feb 28 18:54:02.016824 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 13/24] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:54:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:54:02.079280 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-857da507-ad3f-4e53-a101-3dfb9967dd27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:54:02.173452 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-857da507-ad3f-4e53-a101-3dfb9967dd27 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.150666 Feb 28 18:54:02.174038 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 12/25] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 18:54:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 18:54:02.185582 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-ac439a3e-b702-4690-a191-2d0082de4f6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:54:02.296257 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-ac439a3e-b702-4690-a191-2d0082de4f6a admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114131 Feb 28 18:54:02.296763 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 14/26] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Feb 28 18:54:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 18:54:04.472792 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-857da507-ad3f-4e53-a101-3dfb9967dd27 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:54:04.473780 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-857da507-ad3f-4e53-a101-3dfb9967dd27 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Feb 28 18:54:04.474174 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 13/27] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:54:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:54:04.529887 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-b2bf53ea-5d3d-45d2-8886-b0cb4c31ff34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3", "ram": 4096, "name": "m1.medium", "vcpus": 2}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:54:04.632990 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-b2bf53ea-5d3d-45d2-8886-b0cb4c31ff34 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.152180 Feb 28 18:54:04.633542 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 15/28] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 18:54:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 18:54:04.648221 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-14b16021-6edd-4213-a6b3-75d387f09ae4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:54:04.741404 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-14b16021-6edd-4213-a6b3-75d387f09ae4 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097938 Feb 28 18:54:04.741902 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 14/29] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Feb 28 18:54:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 18:54:06.943566 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-b2bf53ea-5d3d-45d2-8886-b0cb4c31ff34 admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:54:06.944567 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-b2bf53ea-5d3d-45d2-8886-b0cb4c31ff34 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Feb 28 18:54:06.945000 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 16/30] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:54:07.002142 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-ecd21d10-a4e4-430f-a753-0eca7877ccfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "name": "m1.large", "id": "4"}} {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:54:07.081918 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-ecd21d10-a4e4-430f-a753-0eca7877ccfb admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.130129 Feb 28 18:54:07.082469 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 15/31] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 18:54:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 18:54:07.094776 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-50d5e8da-4246-46a7-b18d-1c78d2ef9908 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:54:07.193211 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-50d5e8da-4246-46a7-b18d-1c78d2ef9908 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102282 Feb 28 18:54:07.193785 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 17/32] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Feb 28 18:54:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 18:54:09.362511 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-ecd21d10-a4e4-430f-a753-0eca7877ccfb admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:54:09.363538 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-ecd21d10-a4e4-430f-a753-0eca7877ccfb admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Feb 28 18:54:09.363934 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 16/33] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:54:09.419978 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-49333956-e2ef-4ab9-8d75-358dd017a57b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "id": "5"}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:54:09.495218 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-49333956-e2ef-4ab9-8d75-358dd017a57b admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.124989 Feb 28 18:54:09.495757 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 18/34] 10.222.0.21 () {64 vars in 1282 bytes} [Mon Feb 28 18:54:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 18:54:09.507453 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-75838c2d-7baf-433a-88d9-719369690406 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:54:09.641704 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-75838c2d-7baf-433a-88d9-719369690406 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137799 Feb 28 18:54:09.642288 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 17/35] 10.222.0.21 () {64 vars in 1332 bytes} [Mon Feb 28 18:54:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 18:55:19.905575 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-49333956-e2ef-4ab9-8d75-358dd017a57b admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:19.906577 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-49333956-e2ef-4ab9-8d75-358dd017a57b admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002438 Feb 28 18:55:19.906981 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 19/36] 10.222.0.21 () {54 vars in 930 bytes} [Mon Feb 28 18:55:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:55:19.964603 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-4bf4f2f4-8d15-4330-8d07-07a9237af827 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:19.989837 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-4bf4f2f4-8d15-4330-8d07-07a9237af827 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076829 Feb 28 18:55:19.990381 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 18/37] 10.222.0.21 () {60 vars in 1291 bytes} [Mon Feb 28 18:55:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 18:55:21.421617 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-49333956-e2ef-4ab9-8d75-358dd017a57b admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:21.422598 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-49333956-e2ef-4ab9-8d75-358dd017a57b admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Feb 28 18:55:21.423036 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 20/38] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:55:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:55:21.608842 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-49dc725e-a465-4a8e-a0b6-a9767e804fae admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:21.620930 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.wsgi [None req-49dc725e-a465-4a8e-a0b6-a9767e804fae admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 28 18:55:21.621493 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-49dc725e-a465-4a8e-a0b6-a9767e804fae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 18:55:21.622268 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-49dc725e-a465-4a8e-a0b6-a9767e804fae admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.063625 Feb 28 18:55:21.622824 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 19/39] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Feb 28 18:55:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:21.632698 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-b6968684-07e5-4e5b-b727-e03728bca7f5 admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:21.652808 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-b6968684-07e5-4e5b-b727-e03728bca7f5 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023731 Feb 28 18:55:21.653330 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 21/40] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 18:55:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 18:55:21.663565 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-ec1b8a48-432e-4763-982f-4eb5a9db5b08 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:21.683030 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-ec1b8a48-432e-4763-982f-4eb5a9db5b08 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022930 Feb 28 18:55:21.683594 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 20/41] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 18:55:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 18:55:21.693704 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-8809ff5f-a5a1-481f-a262-e588ebdbf4d6 admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:21.707200 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.wsgi [None req-8809ff5f-a5a1-481f-a262-e588ebdbf4d6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 28 18:55:21.707778 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-8809ff5f-a5a1-481f-a262-e588ebdbf4d6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 18:55:21.708565 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-8809ff5f-a5a1-481f-a262-e588ebdbf4d6 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.018476 Feb 28 18:55:21.709067 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 22/42] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Feb 28 18:55:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:23.065027 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-ec1b8a48-432e-4763-982f-4eb5a9db5b08 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:23.066094 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-ec1b8a48-432e-4763-982f-4eb5a9db5b08 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Feb 28 18:55:23.066495 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 21/43] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:55:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:55:23.252596 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-56b4b2b2-b45c-4d7a-a93f-96d953eff87d admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:23.264373 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.wsgi [None req-56b4b2b2-b45c-4d7a-a93f-96d953eff87d admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 28 18:55:23.264929 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-56b4b2b2-b45c-4d7a-a93f-96d953eff87d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 18:55:23.265700 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-56b4b2b2-b45c-4d7a-a93f-96d953eff87d admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.063095 Feb 28 18:55:23.266196 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 23/44] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Feb 28 18:55:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:23.275690 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-c94e5c08-5f10-413b-a090-4391ea567fe7 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:23.295758 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-c94e5c08-5f10-413b-a090-4391ea567fe7 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023624 Feb 28 18:55:23.297341 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 22/45] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 18:55:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 18:55:23.306780 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-a1d638fd-77ef-456d-bb66-3c0eb0620c6a admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:23.327835 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-a1d638fd-77ef-456d-bb66-3c0eb0620c6a admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024528 Feb 28 18:55:23.328368 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 24/46] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 18:55:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 18:55:23.337465 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-971d7949-cbc6-44ed-bced-3006200b8410 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:23.349491 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.wsgi [None req-971d7949-cbc6-44ed-bced-3006200b8410 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 28 18:55:23.350080 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-971d7949-cbc6-44ed-bced-3006200b8410 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 18:55:23.350839 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-971d7949-cbc6-44ed-bced-3006200b8410 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.016897 Feb 28 18:55:23.351372 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 23/47] 10.222.0.21 () {60 vars in 1190 bytes} [Mon Feb 28 18:55:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:24.715436 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-a1d638fd-77ef-456d-bb66-3c0eb0620c6a admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:24.717104 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-a1d638fd-77ef-456d-bb66-3c0eb0620c6a admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Feb 28 18:55:24.717505 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 25/48] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:55:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:55:24.907600 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-68c4c46c-ad3b-4f4b-8cdb-b77618fc4fb8 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:24.919681 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.wsgi [None req-68c4c46c-ad3b-4f4b-8cdb-b77618fc4fb8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 28 18:55:24.920253 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-68c4c46c-ad3b-4f4b-8cdb-b77618fc4fb8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 18:55:24.921038 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-68c4c46c-ad3b-4f4b-8cdb-b77618fc4fb8 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.065653 Feb 28 18:55:24.921558 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 24/49] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 18:55:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:24.931041 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-8f1c44b4-bceb-448a-9bdc-d41708f36a29 admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:24.952545 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-8f1c44b4-bceb-448a-9bdc-d41708f36a29 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025051 Feb 28 18:55:24.953078 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 26/50] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 18:55:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 18:55:24.962521 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:24.982944 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023806 Feb 28 18:55:24.983538 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 25/51] 10.222.0.21 () {60 vars in 1210 bytes} [Mon Feb 28 18:55:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 18:55:24.992852 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-6bdd46a7-42b0-47e5-9489-c6aa73667cd1 admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:25.005315 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.wsgi [None req-6bdd46a7-42b0-47e5-9489-c6aa73667cd1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 28 18:55:25.005876 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-6bdd46a7-42b0-47e5-9489-c6aa73667cd1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87061) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 18:55:25.006639 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-6bdd46a7-42b0-47e5-9489-c6aa73667cd1 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017321 Feb 28 18:55:25.007137 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 27/52] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 18:55:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 28 18:55:26.364370 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:26.365360 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Feb 28 18:55:26.365757 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 26/53] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:55:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:55:26.556618 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-211f4663-1073-4849-ac35-352b5f07f0f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:55:26.647134 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-211f4663-1073-4849-ac35-352b5f07f0f3 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.140931 Feb 28 18:55:26.647712 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 28/54] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Feb 28 18:55:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 18:55:28.015415 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:28.016425 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Feb 28 18:55:28.016847 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 27/55] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:55:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:55:28.205356 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-416dc082-5e79-4bc9-aac0-3464db223fe6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:55:28.299414 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-416dc082-5e79-4bc9-aac0-3464db223fe6 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.143733 Feb 28 18:55:28.299875 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 29/56] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Feb 28 18:55:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 18:55:29.662732 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:29.663735 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Feb 28 18:55:29.664127 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 28/57] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:55:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:55:29.850991 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-67641c09-345a-4dfc-b01e-2b8996290ff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:55:29.944822 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-67641c09-345a-4dfc-b01e-2b8996290ff6 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.143267 Feb 28 18:55:29.945378 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 30/58] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Feb 28 18:55:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 18:55:31.301642 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:31.302634 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Feb 28 18:55:31.303030 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 29/59] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:55:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:55:31.490228 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-c09e0db6-cf72-4376-96aa-3e7393bfd884 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 18:55:31.577326 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-c09e0db6-cf72-4376-96aa-3e7393bfd884 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.136126 Feb 28 18:55:31.577784 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 31/60] 10.222.0.21 () {64 vars in 1235 bytes} [Mon Feb 28 18:55:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 18:55:32.936254 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:32.937309 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Feb 28 18:55:32.937716 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 30/61] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:55:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:55:33.123394 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-78d42288-66b2-46f1-a6c7-5abd5417a381 admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:55:33.148698 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-78d42288-66b2-46f1-a6c7-5abd5417a381 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.074745 Feb 28 18:55:33.149231 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 32/62] 10.222.0.21 () {60 vars in 1202 bytes} [Mon Feb 28 18:55:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 18:56:13.159759 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:56:13.160746 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-d0dda467-dcbe-4897-a4a9-6a63c12775c6 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Feb 28 18:56:13.161145 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 31/63] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:56:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:56:13.348412 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-986507eb-dc8d-4bf6-9f9f-37a0f3b254dc admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:56:13.373408 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-986507eb-dc8d-4bf6-9f9f-37a0f3b254dc admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075330 Feb 28 18:56:13.373930 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 33/64] 10.222.0.21 () {60 vars in 1202 bytes} [Mon Feb 28 18:56:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 18:57:50.207408 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-7c278e51-003c-401e-bcbd-344a980d24d0 tempest-verify_tempest_config-2067950115 tempest-verify_tempest_config-2067950115-project] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:57:50.209304 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-7c278e51-003c-401e-bcbd-344a980d24d0 tempest-verify_tempest_config-2067950115 tempest-verify_tempest_config-2067950115-project] 10.222.0.21 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.113951 Feb 28 18:57:50.209838 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 32/65] 10.222.0.21 () {58 vars in 1133 bytes} [Mon Feb 28 18:57:50 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 18:59:26.148490 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-986507eb-dc8d-4bf6-9f9f-37a0f3b254dc admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:59:26.149493 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-986507eb-dc8d-4bf6-9f9f-37a0f3b254dc admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Feb 28 18:59:26.149907 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 34/66] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:59:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:59:26.401842 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-40c1b116-1d93-4195-ba9a-3504d9fcf647 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:59:26.404019 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:59:26.404019 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: warnings.warn(msg) Feb 28 18:59:26.405563 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-40c1b116-1d93-4195-ba9a-3504d9fcf647 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:59:26.406222 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-40c1b116-1d93-4195-ba9a-3504d9fcf647 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:59:26.407093 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-40c1b116-1d93-4195-ba9a-3504d9fcf647 admin admin] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:59:26.407585 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-40c1b116-1d93-4195-ba9a-3504d9fcf647 admin admin] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:59:26.441544 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-40c1b116-1d93-4195-ba9a-3504d9fcf647 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.155185 Feb 28 18:59:26.442444 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 33/67] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 18:59:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 18:59:27.808618 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-986507eb-dc8d-4bf6-9f9f-37a0f3b254dc admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:59:27.809814 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-986507eb-dc8d-4bf6-9f9f-37a0f3b254dc admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Feb 28 18:59:27.810211 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 35/68] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:59:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:59:28.004499 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-1f4042a9-95d5-41e8-91d0-54e40d8b1099 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:59:28.010518 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:59:28.010518 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: warnings.warn(msg) Feb 28 18:59:28.010518 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-1f4042a9-95d5-41e8-91d0-54e40d8b1099 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:59:28.010518 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-1f4042a9-95d5-41e8-91d0-54e40d8b1099 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:59:28.010518 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-1f4042a9-95d5-41e8-91d0-54e40d8b1099 admin admin] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:59:28.010518 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-1f4042a9-95d5-41e8-91d0-54e40d8b1099 admin admin] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:59:28.032740 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-1f4042a9-95d5-41e8-91d0-54e40d8b1099 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.079297 Feb 28 18:59:28.033239 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 34/69] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 18:59:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 18:59:39.816469 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-986507eb-dc8d-4bf6-9f9f-37a0f3b254dc admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:59:39.817457 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-986507eb-dc8d-4bf6-9f9f-37a0f3b254dc admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Feb 28 18:59:39.817856 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 36/70] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:59:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:59:40.008579 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-aa920377-e314-4ad8-b9d3-395fa12aa5c5 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:59:40.009715 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:59:40.009715 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: warnings.warn(msg) Feb 28 18:59:40.011237 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-aa920377-e314-4ad8-b9d3-395fa12aa5c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:59:40.011670 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-aa920377-e314-4ad8-b9d3-395fa12aa5c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:59:40.012451 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-aa920377-e314-4ad8-b9d3-395fa12aa5c5 admin admin] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:59:40.012870 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-aa920377-e314-4ad8-b9d3-395fa12aa5c5 admin admin] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:59:40.041512 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-aa920377-e314-4ad8-b9d3-395fa12aa5c5 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.082419 Feb 28 18:59:40.041984 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 35/71] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 18:59:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 18:59:41.415939 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: DEBUG nova.api.openstack.wsgi [None req-986507eb-dc8d-4bf6-9f9f-37a0f3b254dc admin admin] Calling method '>' {{(pid=87061) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:59:41.416961 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: INFO nova.api.openstack.requestlog [None req-986507eb-dc8d-4bf6-9f9f-37a0f3b254dc admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Feb 28 18:59:41.417359 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: [pid: 87061|app: 0|req: 37/72] 10.222.0.21 () {56 vars in 1074 bytes} [Mon Feb 28 18:59:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 18:59:41.608895 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG nova.api.openstack.wsgi [None req-1bf29ad7-df21-43d9-971f-0c8383085a45 admin admin] Calling method '>' {{(pid=87060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 18:59:41.610036 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 18:59:41.610036 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: warnings.warn(msg) Feb 28 18:59:41.611550 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-1bf29ad7-df21-43d9-971f-0c8383085a45 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:59:41.611992 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-1bf29ad7-df21-43d9-971f-0c8383085a45 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:59:41.612766 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-1bf29ad7-df21-43d9-971f-0c8383085a45 admin admin] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 18:59:41.613185 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: DEBUG oslo_concurrency.lockutils [None req-1bf29ad7-df21-43d9-971f-0c8383085a45 admin admin] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 18:59:41.637973 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: INFO nova.api.openstack.requestlog [None req-1bf29ad7-df21-43d9-971f-0c8383085a45 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.079611 Feb 28 18:59:41.638448 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: [pid: 87060|app: 0|req: 36/73] 10.222.0.21 () {60 vars in 1193 bytes} [Mon Feb 28 18:59:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:00:38.677248 dv-cinder-831187-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 28 19:00:38.678430 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: Mon Feb 28 19:00:38 2022 - graceful shutdown triggered... Feb 28 19:00:38.678917 dv-cinder-831187-1-iscsi devstack@n-api.service[87061]: Gracefully killing worker 2 (pid: 87061)... Feb 28 19:00:38.679321 dv-cinder-831187-1-iscsi devstack@n-api.service[87060]: Gracefully killing worker 1 (pid: 87060)... Feb 28 19:00:39.679558 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: worker 1 buried after 1 seconds Feb 28 19:00:39.679558 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: worker 2 buried after 1 seconds Feb 28 19:00:39.679558 dv-cinder-831187-1-iscsi devstack@n-api.service[87059]: goodbye to uWSGI. Feb 28 19:00:39.681121 dv-cinder-831187-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 28 19:00:39.681678 dv-cinder-831187-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 28 19:00:39.684545 dv-cinder-831187-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 28 19:00:39.693642 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 28 19:00:39.695616 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 28 19:00:39 2022] *** Feb 28 19:00:39.695616 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 28 19:00:39.695616 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 28 19:00:39.695616 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: nodename: dv-cinder-831187-1-iscsi Feb 28 19:00:39.695616 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: machine: x86_64 Feb 28 19:00:39.695616 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: clock source: unix Feb 28 19:00:39.695616 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: pcre jit disabled Feb 28 19:00:39.695616 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: detected number of CPU cores: 4 Feb 28 19:00:39.695616 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: current working directory: / Feb 28 19:00:39.695616 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: detected binary path: /usr/bin/uwsgi-core Feb 28 19:00:39.696377 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: your processes number limit is 47680 Feb 28 19:00:39.696377 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: your memory page size is 4096 bytes Feb 28 19:00:39.696377 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: detected max file descriptor number: 2048 Feb 28 19:00:39.696377 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: lock engine: pthread robust mutexes Feb 28 19:00:39.696377 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: thunder lock: enabled Feb 28 19:00:39.696377 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 28 19:00:39.696377 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 28 19:00:39.741394 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: Python main interpreter initialized at 0x5557b8e129c0 Feb 28 19:00:39.741394 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: python threads support enabled Feb 28 19:00:39.741394 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: your server socket listen backlog is limited to 100 connections Feb 28 19:00:39.741394 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: your mercy for graceful operations on workers is 90 seconds Feb 28 19:00:39.741834 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: mapped 403077 bytes (393 KB) for 2 cores Feb 28 19:00:39.741834 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: *** Operational MODE: preforking *** Feb 28 19:00:39.742133 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: *** uWSGI is running in multiple interpreter mode *** Feb 28 19:00:39.742133 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: spawned uWSGI master process (pid: 101772) Feb 28 19:00:39.742340 dv-cinder-831187-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 28 19:00:39.742916 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: spawned uWSGI worker 1 (pid: 101791, cores: 1) Feb 28 19:00:39.743465 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: spawned uWSGI worker 2 (pid: 101792, cores: 1) Feb 28 19:00:39.743771 dv-cinder-831187-1-iscsi devstack@n-api.service[101772]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 28 19:00:43.817682 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 19:00:43.818392 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 19:00:43.818392 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 19:00:43.818743 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 19:00:43.818998 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 19:00:43.819408 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.819731 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.820059 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.820380 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.820740 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.821023 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.821344 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.821683 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.821998 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.822260 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.822574 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.822896 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831187-1-iscsi {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.823247 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.823559 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.823871 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.824206 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.824512 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.824839 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.825138 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.825819 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.827332 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.827332 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.827332 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.827332 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.827660 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.827942 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.828262 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.828573 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.828901 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.829211 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.829546 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831187-1-iscsi {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.829849 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.830161 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.830476 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.830899 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.831272 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.831542 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.831869 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.832198 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.832523 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.832852 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.833183 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.833513 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.833833 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.834151 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.834463 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.834777 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.835098 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.835426 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.835736 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.835986 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.836320 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.836644 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.836983 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.837306 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.837574 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.837838 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.838160 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.838490 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.838801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.839136 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.839225 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 19:00:43.839694 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.839772 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 19:00:43.839843 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.839956 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 19:00:43.840544 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.840703 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 19:00:43.840848 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.841214 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 19:00:43.841422 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.842302 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.842399 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.842399 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.842704 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.842704 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.843168 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.843301 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.843889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.844054 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.844196 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.844373 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.844591 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.844730 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.844872 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.845014 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.845150 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.845287 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.845422 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.845557 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.845743 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.845885 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.846013 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.846148 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831187-1-iscsi {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.846283 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.846418 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.846560 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.846702 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.846838 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.846973 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.847204 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.847497 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.847640 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.847770 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.847904 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.848032 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.848159 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.848375 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.848507 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.848507 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.848754 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.848903 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.849043 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.849188 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.849317 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.849451 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.849578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.849715 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.849850 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.849990 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.850115 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.850251 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.850378 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.850511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.850652 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.850788 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.850923 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.851056 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.851223 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.851364 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.851501 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.851631 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.851801 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831187-1-iscsi {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.851937 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.852072 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.852206 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.852343 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.852470 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.852603 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.852730 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.852730 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.852982 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.853120 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.853255 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.853389 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.853516 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.853719 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.853849 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.853983 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.854110 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.854243 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.854376 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.854517 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.854651 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.854787 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.854920 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.855048 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.855197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.855343 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.855472 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.855606 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.855762 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.855888 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.856021 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.856157 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.856282 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.856422 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.856567 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.857230 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.857406 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.857739 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.857880 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.858022 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.858150 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.858276 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.858485 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.858686 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.858823 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.858960 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.859098 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.859334 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.859463 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.859592 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.859719 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.859860 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.859988 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.860125 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.860273 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.860473 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.860629 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.860768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.860903 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.861048 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.861183 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.861318 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.861458 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.861596 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.861730 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.861867 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.861994 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.862119 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.862257 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.862385 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.862510 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.862636 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.862769 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.862904 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.863044 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.863211 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.863407 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.863547 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.863682 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.863819 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.863948 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.864081 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.864209 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.864343 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.864479 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.864615 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.864750 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.864886 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.865035 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.865163 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.865297 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.865433 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.865567 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.865705 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.865841 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.865975 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.866112 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.866239 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.866375 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.866503 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.866638 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.866778 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.866914 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.867050 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.867219 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.867360 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.867615 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.867926 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.868068 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.868996 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.869155 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.869308 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.869452 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.869610 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.869755 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.869897 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.870059 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.870211 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.870354 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.870517 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.870661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.870661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.870945 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.871095 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.871300 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.871460 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.871613 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.871797 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.871944 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.872106 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.872264 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.872983 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.873181 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.873387 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.873577 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.873725 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.873882 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.874025 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.874167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.874167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.874444 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.874583 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.874800 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.874931 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.875066 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.876107 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.876578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.876719 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.876865 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.877032 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.877257 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.877396 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.877534 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.877677 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.877805 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.878114 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.878256 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.878383 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.878508 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.878645 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.878779 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.878927 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.879234 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.879380 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.879509 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.879647 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.879784 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.879912 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.880106 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.880237 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.880373 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.880501 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.880635 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.880773 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.880909 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.881117 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.881254 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.881386 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.881519 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.881656 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.881793 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.881927 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.882055 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.882190 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.882324 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.882465 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.882606 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.882734 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.882868 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.882997 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.883144 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.883274 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.883418 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.883556 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.883684 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.883811 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.883938 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.884073 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.884210 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.884345 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.884481 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.884617 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.884744 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.884887 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.885016 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.885151 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.885286 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.885421 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.885645 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.885856 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.886000 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.886136 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.886254 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 19:00:43.886388 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.886388 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.886645 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.886774 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.886900 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.887028 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.887182 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.887323 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.887465 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.887601 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.887737 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.888375 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.888517 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.888645 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.888774 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.888901 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.889036 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.889258 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.889390 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.889532 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.889669 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.889805 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.889941 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.889941 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.890197 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.890197 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.890463 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.890591 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.890591 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.890852 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.890993 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.890993 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.891275 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.891411 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.891411 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.891665 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.891803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.891803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.892051 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.892186 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.892321 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.892449 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.892589 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.892717 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.892843 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.892977 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.893112 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.893241 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.893380 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.893515 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.893642 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.893768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.893893 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.894041 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.894171 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.894299 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.894299 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.894547 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.894684 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.894819 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.894948 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.895082 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.895228 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.895357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.895496 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.895634 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.895769 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.895897 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.896030 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.896157 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.896284 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.896425 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.896591 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.896722 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.896899 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.897030 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.897209 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.897340 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.897607 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.897736 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.897863 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.898098 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.898243 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.898476 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.898677 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.898801 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.898920 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.899039 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.899280 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.899477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.899707 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.900017 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.900166 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.900319 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.900486 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.900639 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.900783 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.900933 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.901076 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.901217 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.901437 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.901590 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.901734 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.901885 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.902027 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.902182 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.902331 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.902485 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.902627 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.902779 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.902951 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.903149 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.903310 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.903454 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.903645 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.903802 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.904075 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.904375 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.904523 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.904665 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.904819 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.904969 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.905119 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.905273 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.905417 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.905567 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.905717 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.905867 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.906024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.906174 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.906323 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.906465 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.906624 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.906773 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.906933 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.907084 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.907367 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.907520 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.907670 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.907819 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.907975 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.907975 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.908261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.908403 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.908644 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.908906 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.909069 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.909213 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.909366 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.909602 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.909758 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.909915 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.910067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.910218 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.910360 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.910514 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.910665 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.910822 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.910978 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.911160 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.911321 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.911463 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.911604 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.911755 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.911897 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.912055 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.912207 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.912355 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.912496 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.912646 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.912795 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.912954 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.913107 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.913250 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.913400 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.913542 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.913692 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.913842 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.913984 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.914132 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.914288 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.914430 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.914578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.914730 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.914871 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.915011 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.915261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.915418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.915568 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.915710 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.915857 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.915998 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.916151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.916151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.916429 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.916578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.916730 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.916885 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.917076 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.917230 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.917380 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.917531 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.917687 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.917838 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.917987 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.918159 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.918312 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.918454 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.918602 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.918857 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.919856 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.920183 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.920338 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.920490 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.920640 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.920792 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.920936 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.921078 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.921219 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.921359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.921514 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.921659 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.921812 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.921955 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.922096 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.922237 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.922392 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.922542 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.922694 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.922844 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.922993 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.923152 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.923315 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.923466 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.923618 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.923761 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.923910 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.923910 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.924199 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.924348 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.924498 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.924906 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.925060 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.925211 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.925353 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.925494 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.925642 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.925796 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.925944 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.926100 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.926250 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.926392 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.926541 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.926682 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.926831 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.926982 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.927162 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.927311 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.927464 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.927614 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.927766 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.927919 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.928068 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.928218 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.928369 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.928511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.928660 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.928802 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.929045 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.929285 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.929432 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.929573 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.929739 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.929968 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.930118 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.930275 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.930496 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.930648 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.930789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.930929 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.931079 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.931263 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.931414 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.931555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.931702 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.931863 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.932005 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.932156 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.932306 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.932457 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.932609 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.932750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.932900 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.933051 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.933205 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.933347 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.933488 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.933629 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.933788 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.934005 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.934176 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.934327 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.934470 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.934619 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.934798 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.935813 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.935972 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.936127 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.936280 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.936431 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.936589 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.936751 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.936751 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.937039 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.937182 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.937323 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.937474 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.937617 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.937758 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.937914 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.938057 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.938198 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.938349 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.938499 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.938674 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.938946 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.939291 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.939599 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.939780 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.939957 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.940204 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.940449 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.940637 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.940834 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.941011 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.941011 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.941379 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.941557 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.941741 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.941927 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.942111 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.942286 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.942474 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.942657 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.942846 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.943040 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.943231 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.943420 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.943606 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.943802 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.943988 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.944174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.944174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.944519 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.944696 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.944881 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.945066 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.945242 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.945427 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.945612 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.945788 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.945973 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.946174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.946351 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.946534 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.946710 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.946895 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.947079 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.947376 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.947556 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.947732 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.947916 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.948106 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.948278 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.948456 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.948655 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.948827 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.948985 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.949129 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.949316 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.949540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.949792 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.949950 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.950109 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.950337 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.950572 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.950721 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.950873 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.951028 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.951186 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.951333 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.951487 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.951660 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.951813 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.951964 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.952139 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.952284 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.952454 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.952598 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.952738 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.952889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.953040 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.953191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.953341 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.953491 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.953637 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.953787 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.953936 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.954091 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.954252 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.954410 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.954410 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.954679 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.954838 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.954994 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.955162 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.955326 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.955470 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.955619 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.955773 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.955924 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.956078 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.956221 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.956361 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.956361 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.956646 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.956810 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.956952 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.957092 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.957233 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.957373 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.957523 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.957672 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.957813 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.957962 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.958111 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.958253 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.958403 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.958403 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.958680 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.958835 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.958992 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.959171 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.959319 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.959471 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.959701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.959953 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.960102 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.960244 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.960569 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.960731 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.960895 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.961122 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.961275 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.961426 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.961575 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.961725 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.961867 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.962018 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.962169 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.962321 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.962735 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.962879 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.963030 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.963222 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.963369 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.963511 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.963653 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.963803 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.963955 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.964098 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.964247 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.964389 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.964538 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.964694 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.964851 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.964999 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.965159 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.965302 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.965452 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.965596 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.965751 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.965893 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.966107 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.966274 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.966417 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.966569 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.966725 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.966868 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.967032 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.967222 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.967368 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.967519 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.967669 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.967821 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.967970 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.968112 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.968254 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.968409 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.968559 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.968701 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.968843 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.969003 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.969153 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.969310 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.969453 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.969602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.969844 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.970089 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.970089 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.970383 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.970383 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.970755 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.970904 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.971045 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.971233 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.971378 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.971566 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.971711 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.971853 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.972043 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.972210 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.972356 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.972499 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.972647 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.972789 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.972930 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.972930 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.973219 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.973361 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.973511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.973652 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.973803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.973953 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.974096 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.974236 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.974386 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.974529 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.974679 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.974830 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.974991 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.975194 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.975354 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.975496 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.975652 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.975796 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.975937 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.976078 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.976220 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.976369 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.976521 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.976671 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.976826 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.976989 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.977140 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.977292 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.977435 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.977576 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.977718 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.977859 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.978006 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.978157 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.978307 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.978457 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.978600 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.978748 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.978910 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.979062 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.979226 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.979380 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.979530 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.979680 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.979847 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.980088 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.980316 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.980472 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.980622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.980790 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.981014 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.981014 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.981297 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.981448 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.981590 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.982325 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.982489 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.982641 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.982800 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.982942 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.983091 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.983267 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.983425 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.983587 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.983738 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.983888 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.984030 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.984207 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.984361 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.984513 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.984656 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.984656 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.984934 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.985084 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.985238 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.985238 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.985525 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.985673 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.985815 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.985970 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.986113 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.986253 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.986253 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.986527 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.986677 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.986828 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.986969 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.987134 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.987292 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.987444 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.987585 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.987741 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.987890 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.988043 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.988193 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.988335 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.988494 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.988652 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.988801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.988949 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.989096 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.989344 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.989532 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.989693 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.989851 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.990008 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.990254 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.990254 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.990733 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.990895 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.991191 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.991349 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.991498 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.991663 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.991840 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.991991 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.992138 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.992286 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.992447 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.992615 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.992765 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.992915 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.993067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.993067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.993067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.993067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.993067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.993067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.993067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.993067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.994197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.994197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.994197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.994197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.994197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.994197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.994197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.994197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.995347 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.995347 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.995347 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.995347 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.995347 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.996067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.996213 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.996458 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.996779 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.997111 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.998018 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.998414 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.998733 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.998928 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.999141 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.999343 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.999500 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.999685 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:43.999856 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.000048 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.000237 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.000477 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.000747 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.000903 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.001052 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.001290 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.001457 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.001618 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.001767 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.001915 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.002072 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.002229 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.002394 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.002544 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.002701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.002849 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.002996 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.003192 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.003380 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.003532 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.003532 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.003839 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.003989 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.004151 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.004301 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.004450 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.004607 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.004763 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.004923 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.005081 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.005231 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.005379 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.005535 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.005703 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.005861 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.006024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.006181 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.006337 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.006487 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.006644 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.006806 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.006955 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.007103 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.007294 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.007454 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.007622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.007786 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.007936 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.008187 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.008352 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.008510 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.008669 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.008828 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.008977 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.009124 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.009280 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.009437 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.009605 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.009756 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.009912 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.010073 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.010222 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.010378 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.010630 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.010883 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.011047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.011222 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.011455 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.011621 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.011796 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.011954 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.011954 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.011954 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.012373 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.012373 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.012665 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.013474 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.013866 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.014362 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.014679 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.014995 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.015824 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.015824 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.016173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.016368 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.016368 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.016732 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.016961 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.017304 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.017642 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.017931 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.018097 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.018355 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.018513 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.018662 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.018823 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.018982 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.019234 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.019403 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.019565 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.019724 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.019873 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.020030 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.020189 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.020339 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.020487 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.020653 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.020926 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.021199 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.021369 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.021626 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.021782 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.021782 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.022080 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.022240 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.022390 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.022390 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.022679 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.022837 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.022986 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.023254 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.023426 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.023577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.023725 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.023873 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.024029 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.024193 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.024352 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.024509 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.024666 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.024824 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.024982 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.025140 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.025306 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.025722 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.025878 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.026034 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.026193 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.026353 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.026513 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.026661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.026809 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.026957 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.027137 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.027307 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.027479 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.027640 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.027905 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.028069 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.028228 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.028478 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.029249 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.029420 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.029580 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.029740 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.029740 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.030023 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.030023 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.030325 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.030325 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.030628 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.030778 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.030943 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.031217 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.031475 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.031649 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.031889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.032046 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.032208 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.032370 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.032527 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.032696 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.032847 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.033003 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.033221 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.033374 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.033530 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.033688 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.033846 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.033995 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.034144 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.034144 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.034454 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.034613 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.034784 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.034936 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.035083 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.035267 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.035427 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.035583 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.035731 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.035880 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.036027 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.036183 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.036183 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.036484 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.036633 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.036780 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.036929 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.037076 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.037232 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.037390 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.037551 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.037707 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.037872 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.038101 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.038101 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.038419 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.038663 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.038818 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.038965 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.039141 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.039391 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.039552 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.039724 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.039882 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.040034 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.040191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.040340 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.040497 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.040657 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.040814 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.040962 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.041130 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.041371 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.041631 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.041631 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.042018 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.042185 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.042336 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.042493 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.042650 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.042810 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.042972 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.043181 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.043351 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.043510 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.043667 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.043823 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.043972 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.044415 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.044583 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.044744 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.044905 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.044905 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.045199 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.045371 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.045522 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.045680 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.045838 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.045988 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.045988 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.046281 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.046439 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.046588 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.046736 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.046884 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.047041 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.047236 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.047543 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.047722 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.047882 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.048040 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.048289 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.048447 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.048605 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.048849 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.049016 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.049174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.049337 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.049523 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.049945 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.050098 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.050254 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.050412 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.050578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.050737 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.050887 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.051035 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.051035 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.051388 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.051638 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.051878 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.052057 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.052298 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.052453 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.052722 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.052879 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.053029 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.053187 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.053343 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.053493 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.053654 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.053813 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.053971 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.054120 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.054280 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.054443 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.054593 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.054758 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.054927 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.055077 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.055291 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.055455 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.055605 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.055762 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.055912 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.056069 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.056228 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.056401 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.056551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.056700 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.056849 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.056997 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.057155 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.057315 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.057471 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.057629 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.057629 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.057920 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.058079 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.058262 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.058496 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.058652 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.058801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.059039 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.059229 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.059388 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.059538 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.059687 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.059930 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.060102 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.060351 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.060703 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.060899 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.061056 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.061215 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.061379 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.061531 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.061789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.062054 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.062212 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.062467 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.062632 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.062782 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.062930 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.063079 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.063318 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.063479 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.063642 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.063801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.063951 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.064099 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.064248 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.064409 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.064560 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.064715 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.064867 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.065025 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.065193 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.065354 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.065512 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.065661 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.065809 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.065958 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.066113 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.066281 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.066431 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.066579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.066727 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.066883 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.067032 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.067234 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.067389 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.067540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.067734 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.067893 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.068055 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.068206 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.068357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.068524 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.068759 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.068923 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.069179 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.069347 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.069498 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.069656 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.069656 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.069947 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.070111 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.070261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.070425 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.070577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.070734 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.070891 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.071054 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.071274 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.071438 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.071597 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.071763 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.072001 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.072262 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.072444 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.072672 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.072826 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.072984 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.073147 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.073298 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.073447 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.073608 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.073766 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.073923 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.074081 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.074231 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.074381 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.074529 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.074688 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.074853 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.075002 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.075169 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.075335 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.076511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.076685 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.076847 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.076999 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.077155 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.077305 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.077454 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.077611 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.077774 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.077933 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.078090 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.078246 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.078396 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.078544 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.078739 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.078971 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.079149 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.079384 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.079548 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.079707 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.079857 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.080014 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.080164 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.080362 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.080522 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.080680 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.080847 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.081007 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.081157 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.081313 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.081468 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.081630 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.081788 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.081938 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.082182 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.082438 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.082595 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.082841 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.083006 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 19:00:44.083220 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.083220 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.083220 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.083220 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.083220 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.083220 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.083220 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.083220 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.084359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.084359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.084359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.084359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.084359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.084359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.084359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.084359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.085524 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.085524 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.085524 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.085524 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.085524 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.085524 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.085524 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.085524 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.086680 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.086680 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.086680 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.087151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.087151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.087442 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.087671 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.088004 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.088338 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.088672 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.089032 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.089502 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.089695 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.090029 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 19:00:44.090277 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 19:00:44.126348 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_db.sqlalchemy.engines [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 19:00:44.128424 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_db.sqlalchemy.engines [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 19:00:44.373511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.context [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e343478d-eb46-4c0e-957d-8f9025dbea36(cell1) {{(pid=101792) load_cells /opt/stack/nova/nova/context.py:464}} Feb 28 19:00:44.378521 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:00:44.380215 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:00:44.381027 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:00:44.383012 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:00:44.387286 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.context [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e343478d-eb46-4c0e-957d-8f9025dbea36(cell1) {{(pid=101791) load_cells /opt/stack/nova/nova/context.py:464}} Feb 28 19:00:44.392156 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:00:44.393872 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:00:44.395090 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:00:44.397160 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:00:44.412292 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_db.sqlalchemy.engines [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 19:00:44.418103 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_db.sqlalchemy.engines [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 19:00:44.430428 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_db.sqlalchemy.engines [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 19:00:44.431870 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_db.sqlalchemy.engines [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 19:00:44.451738 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_db.sqlalchemy.engines [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 19:00:44.465311 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_db.sqlalchemy.engines [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 28 19:00:44.705153 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO keyring.backend [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Loading KWallet Feb 28 19:00:44.713688 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO keyring.backend [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Loading KWallet Feb 28 19:00:44.714092 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO keyring.backend [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Loading SecretService Feb 28 19:00:44.718164 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 19:00:44.718164 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: from cryptography.utils import int_from_bytes Feb 28 19:00:44.718499 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 19:00:44.718499 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: from cryptography.utils import int_from_bytes Feb 28 19:00:44.719454 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO keyring.backend [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Loading Windows Feb 28 19:00:44.721281 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO keyring.backend [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Loading chainer Feb 28 19:00:44.722080 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO keyring.backend [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Loading macOS Feb 28 19:00:44.723138 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO keyring.backend [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Loading SecretService Feb 28 19:00:44.726600 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 19:00:44.726600 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: from cryptography.utils import int_from_bytes Feb 28 19:00:44.726919 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 19:00:44.726919 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: from cryptography.utils import int_from_bytes Feb 28 19:00:44.727669 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO keyring.backend [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Loading Windows Feb 28 19:00:44.729474 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO keyring.backend [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Loading chainer Feb 28 19:00:44.730262 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO keyring.backend [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Loading macOS Feb 28 19:00:44.978616 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: WARNING keystonemiddleware.auth_token [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 19:00:44.983895 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: WARNING keystonemiddleware.auth_token [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 19:00:44.985459 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: WARNING keystonemiddleware.auth_token [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 19:00:44.990440 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: WARNING keystonemiddleware.auth_token [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 19:00:45.204622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: WARNING keystonemiddleware.auth_token [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 19:00:45.209402 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: WARNING keystonemiddleware.auth_token [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 28 19:00:45.210050 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: WARNING keystonemiddleware.auth_token [None req-6a1c7d83-1690-48cf-88c7-852ecb7467dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 19:00:45.215229 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557b8e129c0 pid: 101792 (default app) Feb 28 19:00:45.215759 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: WARNING keystonemiddleware.auth_token [None req-b6c85e07-d906-476c-979d-b1fcace9f39b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 28 19:00:45.221544 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557b8e129c0 pid: 101791 (default app) Feb 28 19:01:35.833036 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-327226277", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "networks": [{"uuid": "5969ec6e-bb59-4dca-9873-ec6e8c87d9f4"}]}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:01:35.865446 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f9506a83-661c-4acb-a60f-140a7d46d7e1 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] Action: 'create', calling method: .version_select at 0x7f9130287dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1346194132", "metadata": {"Type": "work"}}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:01:36.379046 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.network.neutron [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] validate_networks() for [('5969ec6e-bb59-4dca-9873-ec6e8c87d9f4', None, None, None)] {{(pid=101791) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:01:37.407866 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f9506a83-661c-4acb-a60f-140a7d46d7e1 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.898263 Feb 28 19:01:37.409379 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 1/1] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Feb 28 19:01:34 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2902 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 28 19:01:37.433880 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-354acedd-1543-4bb8-b98a-f123c4a94727 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] Calling method '.version_select at 0x7f913015f0d0>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:37.561687 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-354acedd-1543-4bb8-b98a-f123c4a94727 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf" status: 200 len: 353 microversion: 2.1 time: 0.143197 Feb 28 19:01:37.562254 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 2/2] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:01:37 2022] GET /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:01:37.838404 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-46a99941-c09a-499d-9033-8db1c0f78bd0 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] Calling method '.version_select at 0x7f913015f940>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:37.935952 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-46a99941-c09a-499d-9033-8db1c0f78bd0 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/7d8ca64c-0314-4eb0-88e3-cd8e065fa3f5" status: 200 len: 350 microversion: 2.1 time: 0.101109 Feb 28 19:01:37.938310 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 3/3] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:01:37 2022] GET /compute/v2.1/os-volumes/7d8ca64c-0314-4eb0-88e3-cd8e065fa3f5 => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:01:38.296726 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Flavor limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:01:38.297204 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Image limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:01:38.297665 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Flavor pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:01:38.298551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Image pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:01:38.298963 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:01:38.326500 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:38.326500 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:38.333341 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:38.333825 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:38.394503 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Getting quotas for project 2234b3391e204ea49d8e31d3731b822c. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:01:38.407167 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Getting quotas for user 46e4e775395f4f01b37ae1e6efe87898 and project 2234b3391e204ea49d8e31d3731b822c. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:01:38.435762 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Going to run 1 instances... {{(pid=101791) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:01:38.439431 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:01:38.548720 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1591094259", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "networks": [{"uuid": "449788a3-ff13-44f6-8b3b-66a4d81bb7d5"}]}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:01:38.618889 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d7993dd7-df78-42b5-b0b8-e336f7d2fd24 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.678620 Feb 28 19:01:38.619841 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 1/4] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:01:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:01:38.638089 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7e4ff5e1-e57e-4f3f-88f5-8a19219b9a9b tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] Calling method '.version_select at 0x7f91300c9ca0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:38.763580 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] validate_networks() for [('449788a3-ff13-44f6-8b3b-66a4d81bb7d5', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:01:38.893203 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7e4ff5e1-e57e-4f3f-88f5-8a19219b9a9b tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf" status: 200 len: 354 microversion: 2.1 time: 0.261977 Feb 28 19:01:38.898959 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 2/5] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:01:38 2022] GET /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf => generated 354 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:01:38.901187 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b16f6d1c-ee88-41bc-ae08-b4e1f849382b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:38.902521 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b16f6d1c-ee88-41bc-ae08-b4e1f849382b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:39.055750 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b16f6d1c-ee88-41bc-ae08-b4e1f849382b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:39.100681 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b16f6d1c-ee88-41bc-ae08-b4e1f849382b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1214 microversion: 2.1 time: 0.204910 Feb 28 19:01:39.101739 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 3/6] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:38 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:39.111083 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1f432815-674b-47c4-8390-1f0834637385 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] Calling method '.version_select at 0x7f912f8523a0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:39.290428 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1f432815-674b-47c4-8390-1f0834637385 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf" status: 200 len: 354 microversion: 2.1 time: 0.186129 Feb 28 19:01:39.295352 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 4/7] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:01:39 2022] GET /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf => generated 354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:01:39.308625 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a31b4a49-e522-4b29-82d1-d18dcc929c6b tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] Calling method '.version_select at 0x7f91300f7550>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:39.617383 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a31b4a49-e522-4b29-82d1-d18dcc929c6b tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf" status: 202 len: 0 microversion: 2.1 time: 0.311927 Feb 28 19:01:39.619347 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 5/8] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 19:01:39 2022] DELETE /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 28 19:01:39.634502 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c1034bd3-dca1-4319-a342-926cf919f8a0 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] Calling method '.version_select at 0x7f912f85e8b0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:39.746799 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c1034bd3-dca1-4319-a342-926cf919f8a0 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf" status: 200 len: 353 microversion: 2.1 time: 0.118488 Feb 28 19:01:39.752708 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 6/9] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:01:39 2022] GET /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:01:40.124522 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-3f259f35-282b-4689-9afe-aafb175a1575 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:40.125865 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-3f259f35-282b-4689-9afe-aafb175a1575 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:40.302654 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-3f259f35-282b-4689-9afe-aafb175a1575 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:40.322108 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-3f259f35-282b-4689-9afe-aafb175a1575 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1214 microversion: 2.1 time: 0.202084 Feb 28 19:01:40.324357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 7/10] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:40 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1214 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:40.366752 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2b7b5996-bb76-4155-ad91-b0b24a0fc0f0 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] Calling method '.version_select at 0x7f912f852310>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:40.491580 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2b7b5996-bb76-4155-ad91-b0b24a0fc0f0 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/812dd146-d1a0-446c-9376-2ccbe78e35e7" status: 200 len: 350 microversion: 2.1 time: 0.129400 Feb 28 19:01:40.493038 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 8/11] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:01:40 2022] GET /compute/v2.1/os-volumes/812dd146-d1a0-446c-9376-2ccbe78e35e7 => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:01:40.759461 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-37e260bf-36a4-4aab-8815-7f8c50483b09 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] Calling method '.version_select at 0x7f912f86b040>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:40.931243 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-37e260bf-36a4-4aab-8815-7f8c50483b09 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] HTTP exception thrown: Volume 6e3cd0b3-b0bc-40c7-b331-13bea5c559bf could not be found. Feb 28 19:01:40.932040 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-37e260bf-36a4-4aab-8815-7f8c50483b09 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] Returning 404 to user: Volume 6e3cd0b3-b0bc-40c7-b331-13bea5c559bf could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:01:40.933032 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-37e260bf-36a4-4aab-8815-7f8c50483b09 tempest-VolumesGetTestJSON-28025875 tempest-VolumesGetTestJSON-28025875-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf" status: 404 len: 109 microversion: 2.1 time: 0.177299 Feb 28 19:01:40.933789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 9/12] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:01:40 2022] GET /compute/v2.1/os-volumes/6e3cd0b3-b0bc-40c7-b331-13bea5c559bf => generated 109 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 19:01:41.342619 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-299565a6-7da6-4afd-9305-d4f84f80a19a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:41.348213 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-299565a6-7da6-4afd-9305-d4f84f80a19a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:41.377268 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-299565a6-7da6-4afd-9305-d4f84f80a19a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:41.377718 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-299565a6-7da6-4afd-9305-d4f84f80a19a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:41.379833 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-299565a6-7da6-4afd-9305-d4f84f80a19a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:41.394247 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-299565a6-7da6-4afd-9305-d4f84f80a19a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:41.916525 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-299565a6-7da6-4afd-9305-d4f84f80a19a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:41.946608 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-299565a6-7da6-4afd-9305-d4f84f80a19a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1218 microversion: 2.1 time: 0.604438 Feb 28 19:01:41.947186 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 10/13] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:41 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1218 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:42.163094 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:01:42.163637 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:01:42.163823 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:01:42.164188 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:01:42.166003 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:01:42.189820 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:42.190271 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:42.191074 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:42.191531 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:42.271578 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Getting quotas for project 498eaf5c78e54296ac5cdeef3489e3ef. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:01:42.288667 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Getting quotas for user 46e767d2e3624a3fa799c8c1b20b0516 and project 498eaf5c78e54296ac5cdeef3489e3ef. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:01:42.317389 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:01:42.320184 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:01:42.630806 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f5c88b32-c8f2-4982-be4d-d7a92a9a2f53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.302409 Feb 28 19:01:42.631478 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 4/14] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:01:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:01:42.643789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-963b3973-647d-4dd6-a6d1-c6bf2040f66d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:42.644468 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-963b3973-647d-4dd6-a6d1-c6bf2040f66d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:42.969368 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8f7b1365-bff6-4ab2-b771-8620abdae2d1 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:42.970007 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8f7b1365-bff6-4ab2-b771-8620abdae2d1 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:43.009670 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8f7b1365-bff6-4ab2-b771-8620abdae2d1 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:43.010111 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8f7b1365-bff6-4ab2-b771-8620abdae2d1 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:43.020798 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8f7b1365-bff6-4ab2-b771-8620abdae2d1 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:43.021272 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8f7b1365-bff6-4ab2-b771-8620abdae2d1 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:43.131464 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-963b3973-647d-4dd6-a6d1-c6bf2040f66d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:43.144954 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-963b3973-647d-4dd6-a6d1-c6bf2040f66d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1218 microversion: 2.1 time: 0.505233 Feb 28 19:01:43.159292 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 11/15] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:42 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1218 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:43.399492 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8f7b1365-bff6-4ab2-b771-8620abdae2d1 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:43.425099 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8f7b1365-bff6-4ab2-b771-8620abdae2d1 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1274 microversion: 2.1 time: 0.464077 Feb 28 19:01:43.427702 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 5/16] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:42 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1274 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:44.119210 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-976b32c2-a143-4d70-a5bd-be7f1a4d331e tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] Calling method '.version_select at 0x7f912f7f4b80>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:44.165693 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1edaa251-9023-48c6-8e53-5a9935bf6120 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:44.166305 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1edaa251-9023-48c6-8e53-5a9935bf6120 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:44.252582 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-976b32c2-a143-4d70-a5bd-be7f1a4d331e tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/7d47654c-ce52-4e29-a190-617412605b36" status: 200 len: 350 microversion: 2.1 time: 0.137833 Feb 28 19:01:44.253484 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 12/17] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:01:44 2022] GET /compute/v2.1/os-volumes/7d47654c-ce52-4e29-a190-617412605b36 => generated 350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:01:44.264500 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2963107a-3e21-4300-a8b3-3ecad4366d2b tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] Calling method '.version_select at 0x7f912f7e15e0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:44.337551 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1edaa251-9023-48c6-8e53-5a9935bf6120 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:44.360980 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1edaa251-9023-48c6-8e53-5a9935bf6120 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1218 microversion: 2.1 time: 0.198800 Feb 28 19:01:44.371244 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 6/18] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:44 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:44.442910 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c4410cd7-bdb1-4e25-b4eb-76960e0ca910 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:44.443553 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c4410cd7-bdb1-4e25-b4eb-76960e0ca910 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:44.456105 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2963107a-3e21-4300-a8b3-3ecad4366d2b tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.195500 Feb 28 19:01:44.456667 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 13/19] 10.222.0.21 () {58 vars in 1133 bytes} [Mon Feb 28 19:01:44 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:01:44.461087 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c4410cd7-bdb1-4e25-b4eb-76960e0ca910 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:44.461718 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c4410cd7-bdb1-4e25-b4eb-76960e0ca910 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:44.465945 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c4410cd7-bdb1-4e25-b4eb-76960e0ca910 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:44.477551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f018132e-1089-4360-a35a-1a8534e064e5 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] Calling method '.version_select at 0x7f912f7e1ee0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:44.486419 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c4410cd7-bdb1-4e25-b4eb-76960e0ca910 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:44.669215 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f018132e-1089-4360-a35a-1a8534e064e5 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.204065 Feb 28 19:01:44.672113 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 14/20] 10.222.0.21 () {58 vars in 1148 bytes} [Mon Feb 28 19:01:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:01:44.684145 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f65a0843-af19-4b70-b6e5-5428ac5c5ebf tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] Calling method '.version_select at 0x7f912f7f4d30>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:44.851418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c4410cd7-bdb1-4e25-b4eb-76960e0ca910 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:44.906647 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c4410cd7-bdb1-4e25-b4eb-76960e0ca910 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1272 microversion: 2.1 time: 0.448757 Feb 28 19:01:44.910444 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f65a0843-af19-4b70-b6e5-5428ac5c5ebf tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.229935 Feb 28 19:01:44.911155 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 15/21] 10.222.0.21 () {58 vars in 1133 bytes} [Mon Feb 28 19:01:44 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:01:44.913115 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 7/22] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:44 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1272 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:01:44.923299 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a2eb27ba-1bcb-441a-b510-92535bb99290 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] Calling method '.version_select at 0x7f912f7e93a0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:45.176519 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a2eb27ba-1bcb-441a-b510-92535bb99290 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.258040 Feb 28 19:01:45.178233 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 16/23] 10.222.0.21 () {58 vars in 1166 bytes} [Mon Feb 28 19:01:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:01:45.192704 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cdc958e0-c35c-471d-b7d5-d32f9a3c36df tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] Calling method '.version_select at 0x7f912f77f280>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:45.392604 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-bd7c4e65-67c7-4d71-8f3d-67910d57a4ab tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:45.393583 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-bd7c4e65-67c7-4d71-8f3d-67910d57a4ab tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:45.413599 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bd7c4e65-67c7-4d71-8f3d-67910d57a4ab tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:45.414709 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bd7c4e65-67c7-4d71-8f3d-67910d57a4ab tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:45.417038 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bd7c4e65-67c7-4d71-8f3d-67910d57a4ab tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:45.418973 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bd7c4e65-67c7-4d71-8f3d-67910d57a4ab tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:45.429985 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-cdc958e0-c35c-471d-b7d5-d32f9a3c36df tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.243275 Feb 28 19:01:45.438596 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 8/24] 10.222.0.21 () {58 vars in 1169 bytes} [Mon Feb 28 19:01:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:01:45.444019 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-078e3ba0-e474-4f26-9973-a6f1930cde1c tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] Calling method '.version_select at 0x7f912f7a8280>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:45.695500 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-078e3ba0-e474-4f26-9973-a6f1930cde1c tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.255106 Feb 28 19:01:45.703579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 9/25] 10.222.0.21 () {58 vars in 1154 bytes} [Mon Feb 28 19:01:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:45.709011 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f139d5fa-fe7b-4784-9663-b3b523ae5265 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] Calling method '.version_select at 0x7f912f748160>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:45.952839 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bd7c4e65-67c7-4d71-8f3d-67910d57a4ab tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:45.956321 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f139d5fa-fe7b-4784-9663-b3b523ae5265 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.251230 Feb 28 19:01:45.956957 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 10/26] 10.222.0.21 () {58 vars in 1187 bytes} [Mon Feb 28 19:01:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:01:45.968657 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7f171abc-c5da-460d-ac8c-85d0dcdf213b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:45.969559 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7f171abc-c5da-460d-ac8c-85d0dcdf213b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:45.970161 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-bd7c4e65-67c7-4d71-8f3d-67910d57a4ab tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1214 microversion: 2.1 time: 0.594113 Feb 28 19:01:45.989769 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 17/27] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:45 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1214 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:45.993154 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f171abc-c5da-460d-ac8c-85d0dcdf213b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:45.998222 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f171abc-c5da-460d-ac8c-85d0dcdf213b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:46.000513 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f171abc-c5da-460d-ac8c-85d0dcdf213b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:46.006952 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f171abc-c5da-460d-ac8c-85d0dcdf213b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:46.011927 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b0bf2726-5d1f-4b61-88b7-66be1eeefd88 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] Calling method '.version_select at 0x7f912f7f4e50>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:46.273718 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b0bf2726-5d1f-4b61-88b7-66be1eeefd88 tempest-VolumesTestJSON-383113819 tempest-VolumesTestJSON-383113819-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.286185 Feb 28 19:01:46.274293 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 18/28] 10.222.0.21 () {58 vars in 1154 bytes} [Mon Feb 28 19:01:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:46.565168 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7f171abc-c5da-460d-ac8c-85d0dcdf213b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:46.588658 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7f171abc-c5da-460d-ac8c-85d0dcdf213b tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1272 microversion: 2.1 time: 0.624014 Feb 28 19:01:46.598339 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 11/29] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:45 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1272 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:46.989958 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-3cc9c6dc-1a3c-4c13-94a3-10c30d0a9655 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:46.990589 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-3cc9c6dc-1a3c-4c13-94a3-10c30d0a9655 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:47.010802 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3cc9c6dc-1a3c-4c13-94a3-10c30d0a9655 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:47.011293 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3cc9c6dc-1a3c-4c13-94a3-10c30d0a9655 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:47.012700 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3cc9c6dc-1a3c-4c13-94a3-10c30d0a9655 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:47.026236 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3cc9c6dc-1a3c-4c13-94a3-10c30d0a9655 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:47.438835 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-3cc9c6dc-1a3c-4c13-94a3-10c30d0a9655 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:47.447463 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-3cc9c6dc-1a3c-4c13-94a3-10c30d0a9655 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1278 microversion: 2.1 time: 0.461332 Feb 28 19:01:47.448053 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 19/30] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:46 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1278 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:47.607003 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-33b6abc0-4be1-4bfc-87a1-aa587683e313 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:47.608372 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-33b6abc0-4be1-4bfc-87a1-aa587683e313 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:47.623172 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33b6abc0-4be1-4bfc-87a1-aa587683e313 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:47.626513 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33b6abc0-4be1-4bfc-87a1-aa587683e313 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:47.629284 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33b6abc0-4be1-4bfc-87a1-aa587683e313 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:47.630964 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33b6abc0-4be1-4bfc-87a1-aa587683e313 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:47.887037 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-33b6abc0-4be1-4bfc-87a1-aa587683e313 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:47.903919 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-33b6abc0-4be1-4bfc-87a1-aa587683e313 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1272 microversion: 2.1 time: 0.301802 Feb 28 19:01:47.904825 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 12/31] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:47 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:48.467537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f7e7cd6e-b82b-41f3-b07d-c9b2ed5d6b4f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:48.469453 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f7e7cd6e-b82b-41f3-b07d-c9b2ed5d6b4f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:48.502538 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7e7cd6e-b82b-41f3-b07d-c9b2ed5d6b4f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:48.506376 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7e7cd6e-b82b-41f3-b07d-c9b2ed5d6b4f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:48.509142 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7e7cd6e-b82b-41f3-b07d-c9b2ed5d6b4f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:48.509802 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7e7cd6e-b82b-41f3-b07d-c9b2ed5d6b4f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:48.921296 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cdbcfc4b-8560-4431-971d-38cc7c806180 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:48.922551 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-cdbcfc4b-8560-4431-971d-38cc7c806180 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:48.934546 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cdbcfc4b-8560-4431-971d-38cc7c806180 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:48.938856 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cdbcfc4b-8560-4431-971d-38cc7c806180 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:48.939889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cdbcfc4b-8560-4431-971d-38cc7c806180 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:48.940496 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cdbcfc4b-8560-4431-971d-38cc7c806180 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:49.033588 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f7e7cd6e-b82b-41f3-b07d-c9b2ed5d6b4f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:49.048406 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f7e7cd6e-b82b-41f3-b07d-c9b2ed5d6b4f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1276 microversion: 2.1 time: 0.586452 Feb 28 19:01:49.049652 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 20/32] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:48 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1276 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:50.068345 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-34d658a3-4d46-4958-a226-221af0d46991 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:50.069989 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-34d658a3-4d46-4958-a226-221af0d46991 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:50.088054 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-34d658a3-4d46-4958-a226-221af0d46991 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:50.088725 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-34d658a3-4d46-4958-a226-221af0d46991 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:50.089760 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-34d658a3-4d46-4958-a226-221af0d46991 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:50.093200 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-34d658a3-4d46-4958-a226-221af0d46991 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:51.306555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cdbcfc4b-8560-4431-971d-38cc7c806180 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:51.320028 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-cdbcfc4b-8560-4431-971d-38cc7c806180 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 2.402343 Feb 28 19:01:51.321124 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 13/33] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:48 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 2404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:01:52.337235 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fe327b2b-b96b-4bab-94f5-88f377bff0d9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:52.338880 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-fe327b2b-b96b-4bab-94f5-88f377bff0d9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:52.348927 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-34d658a3-4d46-4958-a226-221af0d46991 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:52.350357 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fe327b2b-b96b-4bab-94f5-88f377bff0d9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:52.350830 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fe327b2b-b96b-4bab-94f5-88f377bff0d9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:52.356497 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fe327b2b-b96b-4bab-94f5-88f377bff0d9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:52.357059 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fe327b2b-b96b-4bab-94f5-88f377bff0d9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:52.361662 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-34d658a3-4d46-4958-a226-221af0d46991 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 2.296886 Feb 28 19:01:52.362248 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 21/34] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:50 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:01:53.385397 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7eab0c74-fb10-401e-b46b-fa9a5a5c74fa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:53.386090 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7eab0c74-fb10-401e-b46b-fa9a5a5c74fa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:53.406348 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7eab0c74-fb10-401e-b46b-fa9a5a5c74fa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:53.406348 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7eab0c74-fb10-401e-b46b-fa9a5a5c74fa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:53.409826 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7eab0c74-fb10-401e-b46b-fa9a5a5c74fa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:53.410819 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7eab0c74-fb10-401e-b46b-fa9a5a5c74fa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:53.946000 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fe327b2b-b96b-4bab-94f5-88f377bff0d9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:53.972120 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-fe327b2b-b96b-4bab-94f5-88f377bff0d9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 1.636943 Feb 28 19:01:53.974447 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 14/35] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:52 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:01:54.498287 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-49453704", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:01:54.800984 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] validate_networks() for [('b57127cd-5080-498c-a2a9-a9aa12e27acd', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:01:56.884142 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7eab0c74-fb10-401e-b46b-fa9a5a5c74fa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:56.932039 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7eab0c74-fb10-401e-b46b-fa9a5a5c74fa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 3.535293 Feb 28 19:01:56.932415 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 22/36] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:53 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 3558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:01:56.955897 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-fea05da9-f2c1-470e-9c87-272384d475f9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:56.963029 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-fea05da9-f2c1-470e-9c87-272384d475f9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:56.983636 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fea05da9-f2c1-470e-9c87-272384d475f9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:56.984098 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fea05da9-f2c1-470e-9c87-272384d475f9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:56.984887 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fea05da9-f2c1-470e-9c87-272384d475f9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:56.985550 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fea05da9-f2c1-470e-9c87-272384d475f9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:58.487881 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:01:58.488967 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:01:58.489703 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:01:58.492143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:01:58.492918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:01:58.520743 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:58.525247 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:58.530284 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:58.531077 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:58.609859 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Getting quotas for project e8d685b5629d4a8185474969249dbc6e. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:01:58.619977 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Getting quotas for user b929b39cef7546a59987075cdef32d3b and project e8d685b5629d4a8185474969249dbc6e. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:01:58.641434 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-fea05da9-f2c1-470e-9c87-272384d475f9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:58.651040 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:01:58.652200 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:01:58.654792 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-fea05da9-f2c1-470e-9c87-272384d475f9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 1.721110 Feb 28 19:01:58.657848 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 23/37] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:56 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:01:58.861656 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-3fbbc81b-6c67-4269-8440-5d6045706d89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.706945 Feb 28 19:01:58.862379 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 15/38] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:01:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 4709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 28 19:01:59.241523 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-c52afeb5-bf04-49ca-9ca9-c229831cb3eb req-ca38c26e-e143-44e2-8270-d7430e8b41af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7419a104-ba80-4043-87e2-b565459c6f39", "tag": "32302e0f-82da-4b80-902d-b422d9d231e1"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:01:59.244042 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:01:59.244042 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:01:59.291466 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-c52afeb5-bf04-49ca-9ca9-c229831cb3eb req-ca38c26e-e143-44e2-8270-d7430e8b41af service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:59.291929 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-c52afeb5-bf04-49ca-9ca9-c229831cb3eb req-ca38c26e-e143-44e2-8270-d7430e8b41af service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:59.360889 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-c52afeb5-bf04-49ca-9ca9-c229831cb3eb req-ca38c26e-e143-44e2-8270-d7430e8b41af service nova] Creating event network-changed:32302e0f-82da-4b80-902d-b422d9d231e1 for instance 7419a104-ba80-4043-87e2-b565459c6f39 on hv-cinder-83118 Feb 28 19:01:59.362242 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-c52afeb5-bf04-49ca-9ca9-c229831cb3eb req-ca38c26e-e143-44e2-8270-d7430e8b41af service nova] Acquired lock "compute-rpcapi-router" {{(pid=101791) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 28 19:01:59.364566 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5737da9c-8419-481c-9904-0ab67ee3eff0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:59.366151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5737da9c-8419-481c-9904-0ab67ee3eff0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:59.367704 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5737da9c-8419-481c-9904-0ab67ee3eff0 None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:59.368405 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5737da9c-8419-481c-9904-0ab67ee3eff0 None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:59.387567 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-21d5cb21-fb9a-4586-beb7-2bb08daef8d0 req-2d3c090b-3c25-429b-9e35-8820e5b35e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d1ca96-68b1-4b7c-ac23-4b314f12cbb6", "tag": "60d1f848-70b7-4bb1-b406-979cd526e704"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:01:59.390181 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:01:59.390181 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:01:59.410048 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-21d5cb21-fb9a-4586-beb7-2bb08daef8d0 req-2d3c090b-3c25-429b-9e35-8820e5b35e08 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:59.412447 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-21d5cb21-fb9a-4586-beb7-2bb08daef8d0 req-2d3c090b-3c25-429b-9e35-8820e5b35e08 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:59.412833 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.compute.rpcapi [None req-5737da9c-8419-481c-9904-0ab67ee3eff0 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Feb 28 19:01:59.414977 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5737da9c-8419-481c-9904-0ab67ee3eff0 None None] Releasing lock "compute-rpcapi-router" {{(pid=101791) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 28 19:01:59.481033 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-21d5cb21-fb9a-4586-beb7-2bb08daef8d0 req-2d3c090b-3c25-429b-9e35-8820e5b35e08 service nova] Creating event network-changed:60d1f848-70b7-4bb1-b406-979cd526e704 for instance 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 on hv-cinder-83118 Feb 28 19:01:59.485567 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-21d5cb21-fb9a-4586-beb7-2bb08daef8d0 req-2d3c090b-3c25-429b-9e35-8820e5b35e08 service nova] Acquired lock "compute-rpcapi-router" {{(pid=101792) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 28 19:01:59.486219 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5737da9c-8419-481c-9904-0ab67ee3eff0 None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.824520 Feb 28 19:01:59.487744 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 24/39] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:01:59.489298 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-250dd4a6-d669-4955-bbc1-d4f001f03f98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:59.491692 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-250dd4a6-d669-4955-bbc1-d4f001f03f98 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:59.492724 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-250dd4a6-d669-4955-bbc1-d4f001f03f98 None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:59.498489 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-250dd4a6-d669-4955-bbc1-d4f001f03f98 None None] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:59.510079 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-791f0938-181a-426e-8505-08c0ebf80508 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:59.514530 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-791f0938-181a-426e-8505-08c0ebf80508 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:59.534355 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.compute.rpcapi [None req-250dd4a6-d669-4955-bbc1-d4f001f03f98 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Feb 28 19:01:59.535301 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-250dd4a6-d669-4955-bbc1-d4f001f03f98 None None] Releasing lock "compute-rpcapi-router" {{(pid=101792) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 28 19:01:59.544112 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-791f0938-181a-426e-8505-08c0ebf80508 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:59.544491 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-791f0938-181a-426e-8505-08c0ebf80508 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:59.550795 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-791f0938-181a-426e-8505-08c0ebf80508 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:01:59.554940 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-791f0938-181a-426e-8505-08c0ebf80508 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:01:59.584566 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-250dd4a6-d669-4955-bbc1-d4f001f03f98 None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.720796 Feb 28 19:01:59.585747 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 16/40] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:01:59.592530 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-70cd125d-bc69-49df-beee-0de58da1e92a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:01:59.594913 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-70cd125d-bc69-49df-beee-0de58da1e92a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:01:59.905136 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-70cd125d-bc69-49df-beee-0de58da1e92a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:01:59.914816 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-70cd125d-bc69-49df-beee-0de58da1e92a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1220 microversion: 2.1 time: 0.327833 Feb 28 19:01:59.957137 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 17/41] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:59 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1220 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:00.545643 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b0356100-0cd7-482d-add9-46e3dc2e5056 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Action: 'create', calling method: .version_select at 0x7f912f77f670>, body: {"keypair": {"name": "tempest-keypair-1829096883"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:00.726209 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-b0356100-0cd7-482d-add9-46e3dc2e5056 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:02:00.741818 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-b0356100-0cd7-482d-add9-46e3dc2e5056 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for user b9371804d1f943a6b6b3b2a9901030c8 and project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:02:01.006770 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-791f0938-181a-426e-8505-08c0ebf80508 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:01.041201 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-791f0938-181a-426e-8505-08c0ebf80508 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 1.551322 Feb 28 19:02:01.051724 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 25/42] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:01:59 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:01.072452 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ca4b1944-b899-4549-8579-ce7e64ee3c0a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:01.081603 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ca4b1944-b899-4549-8579-ce7e64ee3c0a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:01.109535 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ca4b1944-b899-4549-8579-ce7e64ee3c0a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:01.110146 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ca4b1944-b899-4549-8579-ce7e64ee3c0a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:01.110954 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ca4b1944-b899-4549-8579-ce7e64ee3c0a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:01.111475 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ca4b1944-b899-4549-8579-ce7e64ee3c0a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:01.341590 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-b0356100-0cd7-482d-add9-46e3dc2e5056 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:02:01.347005 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-b0356100-0cd7-482d-add9-46e3dc2e5056 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for user b9371804d1f943a6b6b3b2a9901030c8 and project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:02:01.392321 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b0356100-0cd7-482d-add9-46e3dc2e5056 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.433587 Feb 28 19:02:01.398381 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 18/43] 10.222.0.21 () {62 vars in 1198 bytes} [Mon Feb 28 19:01:59 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1440 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 28 19:02:01.412588 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1705585449", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:01.596835 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] validate_networks() for [('b57127cd-5080-498c-a2a9-a9aa12e27acd', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:02:02.430266 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ca4b1944-b899-4549-8579-ce7e64ee3c0a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:02.445849 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ca4b1944-b899-4549-8579-ce7e64ee3c0a tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 1.390749 Feb 28 19:02:02.463906 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 26/44] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:01 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:02.884806 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6868ca61-8b66-41ef-ba22-1ddd87ed4d14 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Action: 'create', calling method: .version_select at 0x7f912f7e9d30>, body: {"keypair": {"name": "tempest-keypair-163681716"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:02.924863 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-6868ca61-8b66-41ef-ba22-1ddd87ed4d14 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:02:02.935900 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-6868ca61-8b66-41ef-ba22-1ddd87ed4d14 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for user d7a958a47ae44558a637dbe34b5a8f9b and project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:02:03.181826 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:02:03.182808 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:02:03.183572 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:02:03.184338 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:02:03.184949 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:02:03.201534 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:03.202978 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:03.204120 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:03.207327 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:03.258612 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Getting quotas for project e8d685b5629d4a8185474969249dbc6e. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:02:03.265991 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Getting quotas for user b929b39cef7546a59987075cdef32d3b and project e8d685b5629d4a8185474969249dbc6e. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:02:03.296643 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:02:03.302982 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:02:03.492872 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d157873c-ad9a-4f8c-b19d-3420d00b12dc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.092715 Feb 28 19:02:03.493874 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 19/45] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:02:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:02:03.512115 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-557acc45-7fc6-4b10-89fa-41c26dbd5a2f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:03.523473 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-557acc45-7fc6-4b10-89fa-41c26dbd5a2f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:03.532687 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-557acc45-7fc6-4b10-89fa-41c26dbd5a2f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:03.534451 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-557acc45-7fc6-4b10-89fa-41c26dbd5a2f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:03.538281 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-557acc45-7fc6-4b10-89fa-41c26dbd5a2f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:03.540094 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-557acc45-7fc6-4b10-89fa-41c26dbd5a2f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:04.035017 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-6868ca61-8b66-41ef-ba22-1ddd87ed4d14 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:02:04.039268 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-6868ca61-8b66-41ef-ba22-1ddd87ed4d14 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for user d7a958a47ae44558a637dbe34b5a8f9b and project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:02:04.082834 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6868ca61-8b66-41ef-ba22-1ddd87ed4d14 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.617503 Feb 28 19:02:04.083867 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 27/46] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Feb 28 19:02:02 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:04.108522 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-56310580-541c-4dfe-9a9a-93d7a419f075 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:04.113764 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-56310580-541c-4dfe-9a9a-93d7a419f075 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:04.141207 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56310580-541c-4dfe-9a9a-93d7a419f075 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:04.142425 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56310580-541c-4dfe-9a9a-93d7a419f075 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:04.145778 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56310580-541c-4dfe-9a9a-93d7a419f075 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:04.146571 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56310580-541c-4dfe-9a9a-93d7a419f075 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:04.442633 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-557acc45-7fc6-4b10-89fa-41c26dbd5a2f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:04.452015 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-557acc45-7fc6-4b10-89fa-41c26dbd5a2f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 0.956571 Feb 28 19:02:04.461735 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 20/47] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:03 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:04.467182 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-91b1cc9f-5a0b-4c18-8f72-5343a4fe6a59 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:04.467989 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-91b1cc9f-5a0b-4c18-8f72-5343a4fe6a59 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:04.608501 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-91b1cc9f-5a0b-4c18-8f72-5343a4fe6a59 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:04.624554 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-91b1cc9f-5a0b-4c18-8f72-5343a4fe6a59 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1222 microversion: 2.1 time: 0.161401 Feb 28 19:02:04.632499 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 21/48] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:04 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1222 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:04.763475 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-56310580-541c-4dfe-9a9a-93d7a419f075 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:04.776187 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-56310580-541c-4dfe-9a9a-93d7a419f075 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 0.691004 Feb 28 19:02:04.792537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 28/49] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:04 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:05.470178 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7694609d-c873-47cf-a069-7323dd03a1eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:05.470729 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7694609d-c873-47cf-a069-7323dd03a1eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:05.488841 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7694609d-c873-47cf-a069-7323dd03a1eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:05.497918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7694609d-c873-47cf-a069-7323dd03a1eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:05.497918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7694609d-c873-47cf-a069-7323dd03a1eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:05.499367 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7694609d-c873-47cf-a069-7323dd03a1eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:05.649998 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b1350123-c371-4d7f-bf5e-8339061a3d9c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:05.650620 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b1350123-c371-4d7f-bf5e-8339061a3d9c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:05.678080 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1350123-c371-4d7f-bf5e-8339061a3d9c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:05.680930 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1350123-c371-4d7f-bf5e-8339061a3d9c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:05.687922 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1350123-c371-4d7f-bf5e-8339061a3d9c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:05.688611 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1350123-c371-4d7f-bf5e-8339061a3d9c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:06.104481 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b1350123-c371-4d7f-bf5e-8339061a3d9c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:06.149343 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b1350123-c371-4d7f-bf5e-8339061a3d9c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1218 microversion: 2.1 time: 0.502902 Feb 28 19:02:06.153648 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 29/50] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:05 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1218 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:06.168839 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-fd9d99ab-6199-4f3d-87a1-3c1a5ba3ff27 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:06.169790 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-fd9d99ab-6199-4f3d-87a1-3c1a5ba3ff27 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:06.187368 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fd9d99ab-6199-4f3d-87a1-3c1a5ba3ff27 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:06.188418 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fd9d99ab-6199-4f3d-87a1-3c1a5ba3ff27 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:06.189778 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fd9d99ab-6199-4f3d-87a1-3c1a5ba3ff27 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:06.190423 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fd9d99ab-6199-4f3d-87a1-3c1a5ba3ff27 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:06.403394 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7694609d-c873-47cf-a069-7323dd03a1eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:06.416945 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7694609d-c873-47cf-a069-7323dd03a1eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 0.951776 Feb 28 19:02:06.426293 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 22/51] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:05 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:06.889045 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-fd9d99ab-6199-4f3d-87a1-3c1a5ba3ff27 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:06.903578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-fd9d99ab-6199-4f3d-87a1-3c1a5ba3ff27 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 0.738407 Feb 28 19:02:06.904196 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 30/52] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:06 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:07.170396 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2a60dc50-aaaa-49f6-aef5-9bda3f11fd34 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:07.171009 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2a60dc50-aaaa-49f6-aef5-9bda3f11fd34 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:07.182643 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a60dc50-aaaa-49f6-aef5-9bda3f11fd34 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:07.183098 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a60dc50-aaaa-49f6-aef5-9bda3f11fd34 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:07.184299 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a60dc50-aaaa-49f6-aef5-9bda3f11fd34 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:07.184742 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a60dc50-aaaa-49f6-aef5-9bda3f11fd34 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:07.434253 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a37f2932-e188-4ff8-8bff-280fc7077505 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:07.435141 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a37f2932-e188-4ff8-8bff-280fc7077505 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:07.456201 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a37f2932-e188-4ff8-8bff-280fc7077505 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:07.456954 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a37f2932-e188-4ff8-8bff-280fc7077505 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:07.458131 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a37f2932-e188-4ff8-8bff-280fc7077505 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:07.458641 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a37f2932-e188-4ff8-8bff-280fc7077505 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:07.497131 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2a60dc50-aaaa-49f6-aef5-9bda3f11fd34 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:07.513783 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2a60dc50-aaaa-49f6-aef5-9bda3f11fd34 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1282 microversion: 2.1 time: 0.347775 Feb 28 19:02:07.518353 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 23/53] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:07 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1282 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:07.929919 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2d6cd8e2-551d-41ef-a803-c560fdf03a0d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:07.931590 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2d6cd8e2-551d-41ef-a803-c560fdf03a0d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:07.959106 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2d6cd8e2-551d-41ef-a803-c560fdf03a0d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:07.969115 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2d6cd8e2-551d-41ef-a803-c560fdf03a0d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:07.974403 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2d6cd8e2-551d-41ef-a803-c560fdf03a0d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:07.976245 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2d6cd8e2-551d-41ef-a803-c560fdf03a0d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:08.033859 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a37f2932-e188-4ff8-8bff-280fc7077505 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:08.050626 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a37f2932-e188-4ff8-8bff-280fc7077505 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 0.620600 Feb 28 19:02:08.060618 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 31/54] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:07 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:08.538315 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a0cf5081-2d65-4d22-a2f3-21790ecacc57 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:08.539339 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a0cf5081-2d65-4d22-a2f3-21790ecacc57 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:08.561007 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a0cf5081-2d65-4d22-a2f3-21790ecacc57 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:08.563175 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a0cf5081-2d65-4d22-a2f3-21790ecacc57 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:08.565751 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a0cf5081-2d65-4d22-a2f3-21790ecacc57 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:08.568982 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a0cf5081-2d65-4d22-a2f3-21790ecacc57 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:08.867404 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a0cf5081-2d65-4d22-a2f3-21790ecacc57 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:08.881529 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a0cf5081-2d65-4d22-a2f3-21790ecacc57 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1280 microversion: 2.1 time: 0.346366 Feb 28 19:02:08.881529 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 32/55] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:08 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1280 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:08.961841 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2d6cd8e2-551d-41ef-a803-c560fdf03a0d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:08.973841 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2d6cd8e2-551d-41ef-a803-c560fdf03a0d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 1.056537 Feb 28 19:02:08.974665 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 24/56] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:07 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:09.068385 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f9407baa-6283-4b8b-a673-b7e6727bf208 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:09.069727 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f9407baa-6283-4b8b-a673-b7e6727bf208 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:09.079719 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f9407baa-6283-4b8b-a673-b7e6727bf208 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:09.080475 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f9407baa-6283-4b8b-a673-b7e6727bf208 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:09.082104 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f9407baa-6283-4b8b-a673-b7e6727bf208 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:09.082971 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f9407baa-6283-4b8b-a673-b7e6727bf208 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:09.443783 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2070312883", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "099c77b0-b32f-4f92-b4b4-e414371a1e31"}], "security_groups": [{"name": "tempest-securitygroup--1466955126"}], "key_name": "tempest-keypair-1829096883", "user_data": "}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:09.520519 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f9407baa-6283-4b8b-a673-b7e6727bf208 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:09.531390 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f9407baa-6283-4b8b-a673-b7e6727bf208 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 0.467321 Feb 28 19:02:09.533597 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 33/57] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:09 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:09.902857 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-96dd0f84-115a-4d87-bec8-622627a7b72a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:09.904298 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-96dd0f84-115a-4d87-bec8-622627a7b72a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:09.918733 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-96dd0f84-115a-4d87-bec8-622627a7b72a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:09.919969 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-96dd0f84-115a-4d87-bec8-622627a7b72a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:09.921270 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-96dd0f84-115a-4d87-bec8-622627a7b72a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:09.923816 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-96dd0f84-115a-4d87-bec8-622627a7b72a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:10.567291 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] validate_networks() for [('099c77b0-b32f-4f92-b4b4-e414371a1e31', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:02:10.932087 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-96dd0f84-115a-4d87-bec8-622627a7b72a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:10.947541 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-96dd0f84-115a-4d87-bec8-622627a7b72a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 1.052558 Feb 28 19:02:10.948494 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 34/58] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:09 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:10.954147 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8d4c0377-a730-461d-b7ac-dd2e4ffc63a9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:10.955292 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8d4c0377-a730-461d-b7ac-dd2e4ffc63a9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:11.010265 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8d4c0377-a730-461d-b7ac-dd2e4ffc63a9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:11.012145 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8d4c0377-a730-461d-b7ac-dd2e4ffc63a9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:11.014311 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8d4c0377-a730-461d-b7ac-dd2e4ffc63a9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:11.014991 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8d4c0377-a730-461d-b7ac-dd2e4ffc63a9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:11.734302 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8d4c0377-a730-461d-b7ac-dd2e4ffc63a9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:11.742878 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8d4c0377-a730-461d-b7ac-dd2e4ffc63a9 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 0.793013 Feb 28 19:02:11.748633 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 35/59] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:10 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:11.753611 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ef10208f-3736-49d7-bc6d-19c2d33d9949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:11.756532 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ef10208f-3736-49d7-bc6d-19c2d33d9949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:11.775741 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ef10208f-3736-49d7-bc6d-19c2d33d9949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:11.780010 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ef10208f-3736-49d7-bc6d-19c2d33d9949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:11.782778 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ef10208f-3736-49d7-bc6d-19c2d33d9949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:11.783746 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ef10208f-3736-49d7-bc6d-19c2d33d9949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:11.901046 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:02:11.901508 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:02:11.902679 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:02:11.903106 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:02:11.903738 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:02:11.916530 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:11.916992 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:11.917832 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:11.918348 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:11.954725 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:02:11.959922 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for user b9371804d1f943a6b6b3b2a9901030c8 and project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:02:11.973006 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:02:11.975586 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:02:12.183436 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-37dc5be2-a6c8-46fc-80a4-b0beda26be3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.743765 Feb 28 19:02:12.189671 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 25/60] 10.222.0.21 () {62 vars in 1187 bytes} [Mon Feb 28 19:02:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 2751 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 28 19:02:12.194996 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-c0e60b55-c7b3-40af-8fd3-64dd0d21e78e req-267cda76-9ff7-4956-b5cb-ab411485446c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26980bce-633e-4e70-9ebd-c1a38fb5cc4a", "tag": "e2dd1567-70f3-42c6-b7f4-bc55d9e367c2"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:12.197370 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:12.197370 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:02:12.209783 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-c0e60b55-c7b3-40af-8fd3-64dd0d21e78e req-267cda76-9ff7-4956-b5cb-ab411485446c service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:12.210435 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-c0e60b55-c7b3-40af-8fd3-64dd0d21e78e req-267cda76-9ff7-4956-b5cb-ab411485446c service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:12.252200 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-c0e60b55-c7b3-40af-8fd3-64dd0d21e78e req-267cda76-9ff7-4956-b5cb-ab411485446c service nova] Creating event network-changed:e2dd1567-70f3-42c6-b7f4-bc55d9e367c2 for instance 26980bce-633e-4e70-9ebd-c1a38fb5cc4a on hv-cinder-83118 Feb 28 19:02:12.259247 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-c0e60b55-c7b3-40af-8fd3-64dd0d21e78e req-267cda76-9ff7-4956-b5cb-ab411485446c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068040 Feb 28 19:02:12.260112 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 26/61] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:12.261980 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ef10208f-3736-49d7-bc6d-19c2d33d9949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:12.268127 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-35faa6d5-6d52-455a-9d35-66fac6019924 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:12.269109 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-35faa6d5-6d52-455a-9d35-66fac6019924 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:12.270530 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ef10208f-3736-49d7-bc6d-19c2d33d9949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 0.520290 Feb 28 19:02:12.271148 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 36/62] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:11 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:12.280234 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-35faa6d5-6d52-455a-9d35-66fac6019924 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:12.281004 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-35faa6d5-6d52-455a-9d35-66fac6019924 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:12.282234 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-35faa6d5-6d52-455a-9d35-66fac6019924 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:12.282971 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-35faa6d5-6d52-455a-9d35-66fac6019924 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:12.285656 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-861166275", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c812996-20a8-48cd-b6ed-d12028f6c0ff"}], "security_groups": [{"name": "tempest-securitygroup--2044233536"}], "key_name": "tempest-keypair-163681716", "user_data": "}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:12.693697 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.network.neutron [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] validate_networks() for [('1c812996-20a8-48cd-b6ed-d12028f6c0ff', None, None, None)] {{(pid=101791) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:02:13.020229 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-35faa6d5-6d52-455a-9d35-66fac6019924 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:13.039465 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-35faa6d5-6d52-455a-9d35-66fac6019924 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 0.776130 Feb 28 19:02:13.040368 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 27/63] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:12 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:13.051070 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-08883c41-19fc-4bf5-a97b-0b03c11b6d4e req-6536dcc6-bd35-4b5d-9d8a-86f2f0e7b291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8550549-20dd-427f-a2aa-0c06fc252947", "tag": "563c7ae5-b2ec-4f78-aca8-56a58c48d7d3"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:13.063873 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:13.063873 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:02:13.076966 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-08883c41-19fc-4bf5-a97b-0b03c11b6d4e req-6536dcc6-bd35-4b5d-9d8a-86f2f0e7b291 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:13.077758 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-08883c41-19fc-4bf5-a97b-0b03c11b6d4e req-6536dcc6-bd35-4b5d-9d8a-86f2f0e7b291 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:13.100415 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-08883c41-19fc-4bf5-a97b-0b03c11b6d4e req-6536dcc6-bd35-4b5d-9d8a-86f2f0e7b291 service nova] Creating event network-changed:563c7ae5-b2ec-4f78-aca8-56a58c48d7d3 for instance d8550549-20dd-427f-a2aa-0c06fc252947 on hv-cinder-83118 Feb 28 19:02:13.105845 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-08883c41-19fc-4bf5-a97b-0b03c11b6d4e req-6536dcc6-bd35-4b5d-9d8a-86f2f0e7b291 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064097 Feb 28 19:02:13.107314 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 28/64] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:13.118735 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2ae3ea34-de33-4821-82bd-3de52ff1a05a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:13.119443 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2ae3ea34-de33-4821-82bd-3de52ff1a05a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:13.325584 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2ae3ea34-de33-4821-82bd-3de52ff1a05a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:13.338100 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2ae3ea34-de33-4821-82bd-3de52ff1a05a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:13.341452 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2ae3ea34-de33-4821-82bd-3de52ff1a05a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:13.343839 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2ae3ea34-de33-4821-82bd-3de52ff1a05a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1282 microversion: 2.20 time: 0.234342 Feb 28 19:02:13.344889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 29/65] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:13 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1282 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:13.350407 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7f0243e5-3c76-4751-9c85-2a1ce710acd5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:13.351447 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7f0243e5-3c76-4751-9c85-2a1ce710acd5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:13.364721 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f0243e5-3c76-4751-9c85-2a1ce710acd5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:13.365390 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f0243e5-3c76-4751-9c85-2a1ce710acd5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:13.382791 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f0243e5-3c76-4751-9c85-2a1ce710acd5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:13.383015 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f0243e5-3c76-4751-9c85-2a1ce710acd5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:14.017773 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7f0243e5-3c76-4751-9c85-2a1ce710acd5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:14.031990 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7f0243e5-3c76-4751-9c85-2a1ce710acd5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 0.685827 Feb 28 19:02:14.045521 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 30/66] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:13 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:14.056508 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-5bf1cb58-b6d2-4b53-b4ad-768dcf97d140 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:14.057247 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5bf1cb58-b6d2-4b53-b4ad-768dcf97d140 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:14.077263 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5bf1cb58-b6d2-4b53-b4ad-768dcf97d140 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:14.077830 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5bf1cb58-b6d2-4b53-b4ad-768dcf97d140 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:14.078697 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5bf1cb58-b6d2-4b53-b4ad-768dcf97d140 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:14.079241 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5bf1cb58-b6d2-4b53-b4ad-768dcf97d140 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:14.487170 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-5bf1cb58-b6d2-4b53-b4ad-768dcf97d140 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:14.496089 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-5bf1cb58-b6d2-4b53-b4ad-768dcf97d140 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 0.448488 Feb 28 19:02:14.500052 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 31/67] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:14 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:14.511455 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-afcf4863-7fd3-4082-b03b-09cabc9fc7a1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:14.512158 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-afcf4863-7fd3-4082-b03b-09cabc9fc7a1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:14.538111 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-afcf4863-7fd3-4082-b03b-09cabc9fc7a1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:14.549490 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-afcf4863-7fd3-4082-b03b-09cabc9fc7a1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:14.555911 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-afcf4863-7fd3-4082-b03b-09cabc9fc7a1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:14.555911 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-afcf4863-7fd3-4082-b03b-09cabc9fc7a1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:14.582077 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Flavor limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:02:14.582578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Image limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:02:14.583272 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Flavor pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:02:14.583851 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Image pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:02:14.584272 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:02:14.594372 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:14.595344 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:14.612468 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:14.612468 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:14.618231 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:02:14.628853 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for user d7a958a47ae44558a637dbe34b5a8f9b and project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:02:14.644483 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Going to run 1 instances... {{(pid=101791) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:02:14.647943 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:02:14.807564 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-afcf4863-7fd3-4082-b03b-09cabc9fc7a1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:14.817574 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-afcf4863-7fd3-4082-b03b-09cabc9fc7a1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 0.314291 Feb 28 19:02:14.818845 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 32/68] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:14 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:14.857367 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f91a7af8-050f-45b5-a24e-9426cf83274a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.576019 Feb 28 19:02:14.861876 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 37/69] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:02:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:02:14.919296 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cc7fe986-00ec-4399-8ff8-b73c9e34e230 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:14.919985 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-cc7fe986-00ec-4399-8ff8-b73c9e34e230 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:14.942097 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cc7fe986-00ec-4399-8ff8-b73c9e34e230 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:14.942583 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cc7fe986-00ec-4399-8ff8-b73c9e34e230 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:14.949813 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cc7fe986-00ec-4399-8ff8-b73c9e34e230 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:14.949813 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cc7fe986-00ec-4399-8ff8-b73c9e34e230 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:15.154435 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-4e0ee663-1070-4452-bd16-ac86ddf81b16 req-5d206feb-5748-4d8d-a432-9081bf57ba1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d1ca96-68b1-4b7c-ac23-4b314f12cbb6", "name": "network-vif-plugged", "status": "completed", "tag": "60d1f848-70b7-4bb1-b406-979cd526e704"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:15.156157 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:15.156157 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:02:15.164792 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-4e0ee663-1070-4452-bd16-ac86ddf81b16 req-5d206feb-5748-4d8d-a432-9081bf57ba1d service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:15.165715 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-4e0ee663-1070-4452-bd16-ac86ddf81b16 req-5d206feb-5748-4d8d-a432-9081bf57ba1d service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:15.186743 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-4e0ee663-1070-4452-bd16-ac86ddf81b16 req-5d206feb-5748-4d8d-a432-9081bf57ba1d service nova] Creating event network-vif-plugged:60d1f848-70b7-4bb1-b406-979cd526e704 for instance 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 on hv-cinder-83118 Feb 28 19:02:15.191580 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-4e0ee663-1070-4452-bd16-ac86ddf81b16 req-5d206feb-5748-4d8d-a432-9081bf57ba1d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370557 Feb 28 19:02:15.192356 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 33/70] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:15.197391 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-530c587f-6c9c-4fb9-b657-eb352b63054f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:15.198093 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-530c587f-6c9c-4fb9-b657-eb352b63054f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:15.301374 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-cc7fe986-00ec-4399-8ff8-b73c9e34e230 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:15.314028 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-cc7fe986-00ec-4399-8ff8-b73c9e34e230 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:15.318583 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-cc7fe986-00ec-4399-8ff8-b73c9e34e230 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:15.319832 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-cc7fe986-00ec-4399-8ff8-b73c9e34e230 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1334 microversion: 2.20 time: 0.414676 Feb 28 19:02:15.320406 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 38/71] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:14 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1334 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:15.320707 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-530c587f-6c9c-4fb9-b657-eb352b63054f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:15.329375 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-530c587f-6c9c-4fb9-b657-eb352b63054f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1236 microversion: 2.1 time: 0.135856 Feb 28 19:02:15.329963 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 34/72] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:15 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1236 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:15.334482 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c849fd7a-193a-4e6c-b8eb-b8816618bece tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:15.335222 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c849fd7a-193a-4e6c-b8eb-b8816618bece tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:15.346266 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c849fd7a-193a-4e6c-b8eb-b8816618bece tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:15.347031 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c849fd7a-193a-4e6c-b8eb-b8816618bece tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:15.348033 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c849fd7a-193a-4e6c-b8eb-b8816618bece tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:15.348796 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c849fd7a-193a-4e6c-b8eb-b8816618bece tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:15.513439 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fc2a4ae6-b51b-4415-a8aa-eb7d20748c00 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:15.514140 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-fc2a4ae6-b51b-4415-a8aa-eb7d20748c00 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:15.522433 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc2a4ae6-b51b-4415-a8aa-eb7d20748c00 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:15.522971 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc2a4ae6-b51b-4415-a8aa-eb7d20748c00 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:15.523836 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc2a4ae6-b51b-4415-a8aa-eb7d20748c00 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:15.524538 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc2a4ae6-b51b-4415-a8aa-eb7d20748c00 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:15.590953 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c849fd7a-193a-4e6c-b8eb-b8816618bece tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:15.610918 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c849fd7a-193a-4e6c-b8eb-b8816618bece tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 0.286561 Feb 28 19:02:15.622444 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 39/73] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:15 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:15.854664 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0fdebb24-e48c-4d7a-ad5f-f61bea1e1e22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:15.854664 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0fdebb24-e48c-4d7a-ad5f-f61bea1e1e22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:15.854664 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0fdebb24-e48c-4d7a-ad5f-f61bea1e1e22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:15.854664 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0fdebb24-e48c-4d7a-ad5f-f61bea1e1e22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:15.856508 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0fdebb24-e48c-4d7a-ad5f-f61bea1e1e22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:15.856508 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0fdebb24-e48c-4d7a-ad5f-f61bea1e1e22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:16.100749 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fc2a4ae6-b51b-4415-a8aa-eb7d20748c00 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:16.111580 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-fc2a4ae6-b51b-4415-a8aa-eb7d20748c00 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 0.602254 Feb 28 19:02:16.112868 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 35/74] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:15 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:16.260038 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0fdebb24-e48c-4d7a-ad5f-f61bea1e1e22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:16.268166 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0fdebb24-e48c-4d7a-ad5f-f61bea1e1e22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 0.438187 Feb 28 19:02:16.268756 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 40/75] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:15 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:16.338952 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-51bda320-f45c-4114-b1d0-53d6a20f7c5b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:16.340080 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-51bda320-f45c-4114-b1d0-53d6a20f7c5b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:16.346253 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4d10f1ff-c2bb-49f5-9929-48a7147a7b49 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:16.346863 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4d10f1ff-c2bb-49f5-9929-48a7147a7b49 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:16.347579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-51bda320-f45c-4114-b1d0-53d6a20f7c5b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:16.348035 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-51bda320-f45c-4114-b1d0-53d6a20f7c5b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:16.348820 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-51bda320-f45c-4114-b1d0-53d6a20f7c5b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:16.349266 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-51bda320-f45c-4114-b1d0-53d6a20f7c5b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:16.419567 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4d10f1ff-c2bb-49f5-9929-48a7147a7b49 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:16.428473 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4d10f1ff-c2bb-49f5-9929-48a7147a7b49 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1236 microversion: 2.1 time: 0.085835 Feb 28 19:02:16.429163 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 41/76] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:16 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:16.469468 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-51bda320-f45c-4114-b1d0-53d6a20f7c5b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:16.485663 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-51bda320-f45c-4114-b1d0-53d6a20f7c5b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:16.485663 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-51bda320-f45c-4114-b1d0-53d6a20f7c5b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:16.485663 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-51bda320-f45c-4114-b1d0-53d6a20f7c5b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1342 microversion: 2.20 time: 0.150224 Feb 28 19:02:16.496396 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 36/77] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:16 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:16.630226 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0b491cb6-ca26-4669-8470-594a7214f222 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:16.630953 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0b491cb6-ca26-4669-8470-594a7214f222 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:16.650911 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0b491cb6-ca26-4669-8470-594a7214f222 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:16.652252 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0b491cb6-ca26-4669-8470-594a7214f222 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:16.653613 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0b491cb6-ca26-4669-8470-594a7214f222 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:16.655951 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0b491cb6-ca26-4669-8470-594a7214f222 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:17.050762 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0b491cb6-ca26-4669-8470-594a7214f222 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:17.060096 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0b491cb6-ca26-4669-8470-594a7214f222 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 0.435276 Feb 28 19:02:17.060670 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 42/78] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:16 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:17.128490 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8c88339e-7459-4439-bca7-02831ff7eeca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:17.129599 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8c88339e-7459-4439-bca7-02831ff7eeca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:17.149814 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8c88339e-7459-4439-bca7-02831ff7eeca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:17.151625 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8c88339e-7459-4439-bca7-02831ff7eeca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:17.152530 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8c88339e-7459-4439-bca7-02831ff7eeca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:17.152886 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8c88339e-7459-4439-bca7-02831ff7eeca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:17.206495 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-6f8b1714-f883-45d5-a894-1933de20fcf5 req-ab419138-f1df-4abc-956a-6d87fb3d2ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7419a104-ba80-4043-87e2-b565459c6f39", "name": "network-vif-plugged", "status": "completed", "tag": "32302e0f-82da-4b80-902d-b422d9d231e1"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:17.208364 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:17.208364 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:02:17.222085 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-6f8b1714-f883-45d5-a894-1933de20fcf5 req-ab419138-f1df-4abc-956a-6d87fb3d2ec1 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:17.222888 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-6f8b1714-f883-45d5-a894-1933de20fcf5 req-ab419138-f1df-4abc-956a-6d87fb3d2ec1 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:17.269160 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-6f8b1714-f883-45d5-a894-1933de20fcf5 req-ab419138-f1df-4abc-956a-6d87fb3d2ec1 service nova] Creating event network-vif-plugged:32302e0f-82da-4b80-902d-b422d9d231e1 for instance 7419a104-ba80-4043-87e2-b565459c6f39 on hv-cinder-83118 Feb 28 19:02:17.274734 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-6f8b1714-f883-45d5-a894-1933de20fcf5 req-ab419138-f1df-4abc-956a-6d87fb3d2ec1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072219 Feb 28 19:02:17.275946 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 43/79] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:02:17.299673 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-3b43552d-c8d6-425f-9d96-fa2d00851e0b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:17.304752 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-3b43552d-c8d6-425f-9d96-fa2d00851e0b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:17.324873 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3b43552d-c8d6-425f-9d96-fa2d00851e0b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:17.334033 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3b43552d-c8d6-425f-9d96-fa2d00851e0b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:17.334033 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3b43552d-c8d6-425f-9d96-fa2d00851e0b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:17.334033 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3b43552d-c8d6-425f-9d96-fa2d00851e0b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:17.841134 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8c88339e-7459-4439-bca7-02831ff7eeca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:17.848508 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8c88339e-7459-4439-bca7-02831ff7eeca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 0.723505 Feb 28 19:02:17.849181 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 37/80] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:17 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:17.854534 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-bcac7732-4984-4907-9d5d-25baaeae0bdf tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:17.855621 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-bcac7732-4984-4907-9d5d-25baaeae0bdf tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:17.863822 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bcac7732-4984-4907-9d5d-25baaeae0bdf tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:17.864533 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bcac7732-4984-4907-9d5d-25baaeae0bdf tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:17.865551 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bcac7732-4984-4907-9d5d-25baaeae0bdf tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:17.865988 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bcac7732-4984-4907-9d5d-25baaeae0bdf tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:17.893124 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-3b43552d-c8d6-425f-9d96-fa2d00851e0b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:17.907811 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-3b43552d-c8d6-425f-9d96-fa2d00851e0b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 0.626648 Feb 28 19:02:17.921502 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 44/81] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:17 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:17.935463 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-644fe2f6-60a2-4488-94bd-54d0561c659f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:17.937568 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-644fe2f6-60a2-4488-94bd-54d0561c659f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:17.958257 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-644fe2f6-60a2-4488-94bd-54d0561c659f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:17.967382 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-644fe2f6-60a2-4488-94bd-54d0561c659f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:17.967382 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-644fe2f6-60a2-4488-94bd-54d0561c659f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:17.967382 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-644fe2f6-60a2-4488-94bd-54d0561c659f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:18.207759 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-bcac7732-4984-4907-9d5d-25baaeae0bdf tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:18.221916 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-bcac7732-4984-4907-9d5d-25baaeae0bdf tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1232 microversion: 2.1 time: 0.371263 Feb 28 19:02:18.223918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 38/82] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:17 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1232 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:18.232519 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f1517adc-824b-4c91-880c-e283dea3bf3e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:18.233404 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f1517adc-824b-4c91-880c-e283dea3bf3e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:18.261979 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1517adc-824b-4c91-880c-e283dea3bf3e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:18.268152 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1517adc-824b-4c91-880c-e283dea3bf3e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:18.289276 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1517adc-824b-4c91-880c-e283dea3bf3e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:18.289276 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1517adc-824b-4c91-880c-e283dea3bf3e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:18.747432 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f1517adc-824b-4c91-880c-e283dea3bf3e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:18.749779 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-644fe2f6-60a2-4488-94bd-54d0561c659f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:18.756906 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f1517adc-824b-4c91-880c-e283dea3bf3e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1314 microversion: 2.1 time: 0.531763 Feb 28 19:02:18.766220 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 39/83] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:18 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:18.771961 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-644fe2f6-60a2-4488-94bd-54d0561c659f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:18.774829 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-644fe2f6-60a2-4488-94bd-54d0561c659f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:18.776953 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-644fe2f6-60a2-4488-94bd-54d0561c659f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.852933 Feb 28 19:02:18.777687 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 45/84] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:17 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:18.866528 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-06b70054-0d0f-4b0e-a084-02cb7ff7c4ae tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:18.867217 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-06b70054-0d0f-4b0e-a084-02cb7ff7c4ae tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:18.880745 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-06b70054-0d0f-4b0e-a084-02cb7ff7c4ae tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:18.881190 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-06b70054-0d0f-4b0e-a084-02cb7ff7c4ae tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:18.881974 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-06b70054-0d0f-4b0e-a084-02cb7ff7c4ae tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:18.884485 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-06b70054-0d0f-4b0e-a084-02cb7ff7c4ae tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:18.926263 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8c6a1454-f181-419f-a1fc-7bc76d56e34f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:18.926873 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8c6a1454-f181-419f-a1fc-7bc76d56e34f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:18.938626 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c6a1454-f181-419f-a1fc-7bc76d56e34f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:18.942750 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c6a1454-f181-419f-a1fc-7bc76d56e34f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:18.943811 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c6a1454-f181-419f-a1fc-7bc76d56e34f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:18.944406 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c6a1454-f181-419f-a1fc-7bc76d56e34f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:19.801135 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8c6a1454-f181-419f-a1fc-7bc76d56e34f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:19.815761 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8c6a1454-f181-419f-a1fc-7bc76d56e34f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 0.891868 Feb 28 19:02:19.817726 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 46/85] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:18 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:19.829931 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-92f95fbd-33fa-4f79-9805-e51227da7785 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:19.831429 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-92f95fbd-33fa-4f79-9805-e51227da7785 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:19.849746 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-92f95fbd-33fa-4f79-9805-e51227da7785 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:19.851551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-92f95fbd-33fa-4f79-9805-e51227da7785 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:19.852612 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-92f95fbd-33fa-4f79-9805-e51227da7785 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:19.856625 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-92f95fbd-33fa-4f79-9805-e51227da7785 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:19.904908 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-06b70054-0d0f-4b0e-a084-02cb7ff7c4ae tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:19.919030 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-06b70054-0d0f-4b0e-a084-02cb7ff7c4ae tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1318 microversion: 2.1 time: 1.053535 Feb 28 19:02:19.920119 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 40/86] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:18 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1318 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:19.940066 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cfa77cbd-165f-4621-abf1-9694d3b9c376 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:19.943703 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-cfa77cbd-165f-4621-abf1-9694d3b9c376 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:19.956194 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cfa77cbd-165f-4621-abf1-9694d3b9c376 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:19.957402 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cfa77cbd-165f-4621-abf1-9694d3b9c376 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:19.958407 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cfa77cbd-165f-4621-abf1-9694d3b9c376 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:19.959403 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cfa77cbd-165f-4621-abf1-9694d3b9c376 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:20.123787 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-92f95fbd-33fa-4f79-9805-e51227da7785 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:20.141703 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-92f95fbd-33fa-4f79-9805-e51227da7785 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1294 microversion: 2.1 time: 0.321699 Feb 28 19:02:20.142306 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 47/87] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:19 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1294 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:20.157618 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9ee888ad-0262-4447-b487-97f73aafb110 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:20.158232 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9ee888ad-0262-4447-b487-97f73aafb110 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:20.183521 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ee888ad-0262-4447-b487-97f73aafb110 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:20.184082 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ee888ad-0262-4447-b487-97f73aafb110 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:20.184910 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ee888ad-0262-4447-b487-97f73aafb110 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:20.185346 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ee888ad-0262-4447-b487-97f73aafb110 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:20.699390 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cfa77cbd-165f-4621-abf1-9694d3b9c376 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:20.707982 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-cfa77cbd-165f-4621-abf1-9694d3b9c376 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1500 microversion: 2.1 time: 0.786002 Feb 28 19:02:20.708650 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 41/88] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:19 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1500 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:20.713305 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-b9f3b1dd-2cbf-468f-839b-67bbea6dc317 req-8ae1810e-aed3-4a0c-85de-bafbdb2ad027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70", "tag": "7caa3a37-72ae-4e36-90cf-0f518cb19c37"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:20.715526 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:20.715526 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:02:20.727903 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-b9f3b1dd-2cbf-468f-839b-67bbea6dc317 req-8ae1810e-aed3-4a0c-85de-bafbdb2ad027 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:20.727903 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-b9f3b1dd-2cbf-468f-839b-67bbea6dc317 req-8ae1810e-aed3-4a0c-85de-bafbdb2ad027 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:20.740429 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-b9f3b1dd-2cbf-468f-839b-67bbea6dc317 req-8ae1810e-aed3-4a0c-85de-bafbdb2ad027 service nova] Creating event network-changed:7caa3a37-72ae-4e36-90cf-0f518cb19c37 for instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 on hv-cinder-83118 Feb 28 19:02:20.745985 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-b9f3b1dd-2cbf-468f-839b-67bbea6dc317 req-8ae1810e-aed3-4a0c-85de-bafbdb2ad027 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035828 Feb 28 19:02:20.746580 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 42/89] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:20.838578 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-3189e3ff-9d99-483d-ae20-8c46a6fec53a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:20.840356 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3189e3ff-9d99-483d-ae20-8c46a6fec53a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:20.854742 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3189e3ff-9d99-483d-ae20-8c46a6fec53a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:20.855724 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3189e3ff-9d99-483d-ae20-8c46a6fec53a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:20.856903 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3189e3ff-9d99-483d-ae20-8c46a6fec53a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:20.858181 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3189e3ff-9d99-483d-ae20-8c46a6fec53a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:21.055505 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9ee888ad-0262-4447-b487-97f73aafb110 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:21.067948 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9ee888ad-0262-4447-b487-97f73aafb110 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:21.069894 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9ee888ad-0262-4447-b487-97f73aafb110 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:21.071020 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9ee888ad-0262-4447-b487-97f73aafb110 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.922993 Feb 28 19:02:21.071605 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 48/90] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:20 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:21.076327 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8921ad16-70f9-4f8f-860b-d6ad1471c83f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:21.076892 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8921ad16-70f9-4f8f-860b-d6ad1471c83f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:21.084004 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8921ad16-70f9-4f8f-860b-d6ad1471c83f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:21.084494 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8921ad16-70f9-4f8f-860b-d6ad1471c83f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:21.085255 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8921ad16-70f9-4f8f-860b-d6ad1471c83f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:21.085785 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8921ad16-70f9-4f8f-860b-d6ad1471c83f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:21.153713 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-3189e3ff-9d99-483d-ae20-8c46a6fec53a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:21.163199 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-3189e3ff-9d99-483d-ae20-8c46a6fec53a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 0.332177 Feb 28 19:02:21.164099 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 43/91] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:20 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:21.177994 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-49aff4ae-010b-4477-98a6-1270cfcbbce0 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:21.178608 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-49aff4ae-010b-4477-98a6-1270cfcbbce0 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:21.186069 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49aff4ae-010b-4477-98a6-1270cfcbbce0 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:21.186634 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49aff4ae-010b-4477-98a6-1270cfcbbce0 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:21.187478 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49aff4ae-010b-4477-98a6-1270cfcbbce0 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:21.187912 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49aff4ae-010b-4477-98a6-1270cfcbbce0 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:21.431015 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8921ad16-70f9-4f8f-860b-d6ad1471c83f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:21.439786 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8921ad16-70f9-4f8f-860b-d6ad1471c83f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1507 microversion: 2.1 time: 0.367188 Feb 28 19:02:21.440651 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 49/92] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:21 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:21.506941 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-49aff4ae-010b-4477-98a6-1270cfcbbce0 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:21.520320 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-49aff4ae-010b-4477-98a6-1270cfcbbce0 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.345761 Feb 28 19:02:21.529431 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 44/93] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:21 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:22.088587 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7bc4807b-ee33-4591-9d0c-dcff6e5d4057 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:22.089138 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7bc4807b-ee33-4591-9d0c-dcff6e5d4057 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:22.096231 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bc4807b-ee33-4591-9d0c-dcff6e5d4057 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:22.096682 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bc4807b-ee33-4591-9d0c-dcff6e5d4057 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:22.097449 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bc4807b-ee33-4591-9d0c-dcff6e5d4057 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:22.097881 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bc4807b-ee33-4591-9d0c-dcff6e5d4057 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:22.180640 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f1d80b43-4999-4330-8346-0019a77f067f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:22.181376 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f1d80b43-4999-4330-8346-0019a77f067f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:22.191122 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1d80b43-4999-4330-8346-0019a77f067f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:22.194000 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1d80b43-4999-4330-8346-0019a77f067f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:22.194803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1d80b43-4999-4330-8346-0019a77f067f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:22.196993 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1d80b43-4999-4330-8346-0019a77f067f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:22.426343 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7bc4807b-ee33-4591-9d0c-dcff6e5d4057 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:22.439125 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7bc4807b-ee33-4591-9d0c-dcff6e5d4057 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:22.441160 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7bc4807b-ee33-4591-9d0c-dcff6e5d4057 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:22.442967 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7bc4807b-ee33-4591-9d0c-dcff6e5d4057 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.357467 Feb 28 19:02:22.444324 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 50/94] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:22 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:22.518030 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f1d80b43-4999-4330-8346-0019a77f067f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:22.526882 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f1d80b43-4999-4330-8346-0019a77f067f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 0.349143 Feb 28 19:02:22.534075 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 45/95] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:22 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:22.541667 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-efba229b-a79f-49cb-81a9-ce9e18d7ef1e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:22.546994 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-efba229b-a79f-49cb-81a9-ce9e18d7ef1e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:22.552975 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-efba229b-a79f-49cb-81a9-ce9e18d7ef1e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:22.554723 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-efba229b-a79f-49cb-81a9-ce9e18d7ef1e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:22.555727 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-efba229b-a79f-49cb-81a9-ce9e18d7ef1e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:22.556315 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-efba229b-a79f-49cb-81a9-ce9e18d7ef1e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:22.621466 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-ff3c318e-cf55-4392-8eed-c1d0e6f5bd23 req-c084716e-ec37-4f09-ba95-a7f44f418991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26980bce-633e-4e70-9ebd-c1a38fb5cc4a", "name": "network-vif-plugged", "status": "completed", "tag": "e2dd1567-70f3-42c6-b7f4-bc55d9e367c2"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:22.625504 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:22.625504 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:02:22.637732 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-ff3c318e-cf55-4392-8eed-c1d0e6f5bd23 req-c084716e-ec37-4f09-ba95-a7f44f418991 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:22.638456 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-ff3c318e-cf55-4392-8eed-c1d0e6f5bd23 req-c084716e-ec37-4f09-ba95-a7f44f418991 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:22.656211 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-ff3c318e-cf55-4392-8eed-c1d0e6f5bd23 req-c084716e-ec37-4f09-ba95-a7f44f418991 service nova] Creating event network-vif-plugged:e2dd1567-70f3-42c6-b7f4-bc55d9e367c2 for instance 26980bce-633e-4e70-9ebd-c1a38fb5cc4a on hv-cinder-83118 Feb 28 19:02:22.661949 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-ff3c318e-cf55-4392-8eed-c1d0e6f5bd23 req-c084716e-ec37-4f09-ba95-a7f44f418991 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045062 Feb 28 19:02:22.666831 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 46/96] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:22.834189 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-efba229b-a79f-49cb-81a9-ce9e18d7ef1e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:22.843917 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-efba229b-a79f-49cb-81a9-ce9e18d7ef1e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.306284 Feb 28 19:02:22.844605 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 51/97] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:22 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:23.461568 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6de949ad-3c56-481a-9b75-687e84022c30 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:23.462882 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6de949ad-3c56-481a-9b75-687e84022c30 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:23.471925 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6de949ad-3c56-481a-9b75-687e84022c30 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:23.472712 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6de949ad-3c56-481a-9b75-687e84022c30 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:23.473709 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6de949ad-3c56-481a-9b75-687e84022c30 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:23.474354 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6de949ad-3c56-481a-9b75-687e84022c30 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:23.546009 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9c710104-4e07-4f18-bf24-cf979a745678 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:23.546669 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9c710104-4e07-4f18-bf24-cf979a745678 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:23.563611 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9c710104-4e07-4f18-bf24-cf979a745678 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:23.566891 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9c710104-4e07-4f18-bf24-cf979a745678 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:23.567736 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9c710104-4e07-4f18-bf24-cf979a745678 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:23.568181 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9c710104-4e07-4f18-bf24-cf979a745678 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:23.994845 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6de949ad-3c56-481a-9b75-687e84022c30 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:24.014285 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6de949ad-3c56-481a-9b75-687e84022c30 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:24.015863 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6de949ad-3c56-481a-9b75-687e84022c30 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:24.016982 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6de949ad-3c56-481a-9b75-687e84022c30 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.559537 Feb 28 19:02:24.017540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 47/98] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:23 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:24.022859 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ac2b8e5a-51b0-47bb-8c3c-f0ac1a6f800e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:24.023676 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ac2b8e5a-51b0-47bb-8c3c-f0ac1a6f800e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:24.030735 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9c710104-4e07-4f18-bf24-cf979a745678 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:24.032302 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ac2b8e5a-51b0-47bb-8c3c-f0ac1a6f800e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:24.032921 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ac2b8e5a-51b0-47bb-8c3c-f0ac1a6f800e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:24.034190 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ac2b8e5a-51b0-47bb-8c3c-f0ac1a6f800e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:24.034768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ac2b8e5a-51b0-47bb-8c3c-f0ac1a6f800e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:24.044079 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9c710104-4e07-4f18-bf24-cf979a745678 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 0.503750 Feb 28 19:02:24.045095 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 52/99] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:23 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:24.442581 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ac2b8e5a-51b0-47bb-8c3c-f0ac1a6f800e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:24.453067 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ac2b8e5a-51b0-47bb-8c3c-f0ac1a6f800e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.432415 Feb 28 19:02:24.453067 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 48/100] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:24 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:24.465750 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-1af2d993-9230-4f83-8239-cc2ba8b25959 req-150a4d85-b957-40d8-a898-238997497c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45883a52-0422-4de3-b428-d6f24780b283", "tag": "f30d713e-926a-4637-924b-eabbced9f31c"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:24.467375 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:24.467375 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:02:24.476972 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-1af2d993-9230-4f83-8239-cc2ba8b25959 req-150a4d85-b957-40d8-a898-238997497c75 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:24.477410 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-1af2d993-9230-4f83-8239-cc2ba8b25959 req-150a4d85-b957-40d8-a898-238997497c75 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:24.509128 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-1af2d993-9230-4f83-8239-cc2ba8b25959 req-150a4d85-b957-40d8-a898-238997497c75 service nova] Creating event network-changed:f30d713e-926a-4637-924b-eabbced9f31c for instance 45883a52-0422-4de3-b428-d6f24780b283 on hv-cinder-83118 Feb 28 19:02:24.515294 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-1af2d993-9230-4f83-8239-cc2ba8b25959 req-150a4d85-b957-40d8-a898-238997497c75 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055130 Feb 28 19:02:24.516206 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 53/101] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:24.676141 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-9f96f245-37b0-4146-a6a2-455c5fa77b1b req-4d64e942-9045-4248-a92c-fae74e6c2351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8550549-20dd-427f-a2aa-0c06fc252947", "name": "network-vif-plugged", "status": "completed", "tag": "563c7ae5-b2ec-4f78-aca8-56a58c48d7d3"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:24.677807 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:24.677807 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:02:24.686481 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-9f96f245-37b0-4146-a6a2-455c5fa77b1b req-4d64e942-9045-4248-a92c-fae74e6c2351 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:24.686999 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-9f96f245-37b0-4146-a6a2-455c5fa77b1b req-4d64e942-9045-4248-a92c-fae74e6c2351 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:24.704808 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-9f96f245-37b0-4146-a6a2-455c5fa77b1b req-4d64e942-9045-4248-a92c-fae74e6c2351 service nova] Creating event network-vif-plugged:563c7ae5-b2ec-4f78-aca8-56a58c48d7d3 for instance d8550549-20dd-427f-a2aa-0c06fc252947 on hv-cinder-83118 Feb 28 19:02:24.710899 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-9f96f245-37b0-4146-a6a2-455c5fa77b1b req-4d64e942-9045-4248-a92c-fae74e6c2351 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037429 Feb 28 19:02:24.711519 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 49/102] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:25.036089 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-afea9b60-b36b-421f-b64c-ce99ccd7606b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:25.037512 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-afea9b60-b36b-421f-b64c-ce99ccd7606b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:25.048378 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-afea9b60-b36b-421f-b64c-ce99ccd7606b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:25.049845 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-afea9b60-b36b-421f-b64c-ce99ccd7606b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:25.050740 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-afea9b60-b36b-421f-b64c-ce99ccd7606b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:25.051294 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-afea9b60-b36b-421f-b64c-ce99ccd7606b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:25.062175 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7e0e1e38-1e13-4ebf-80a6-48b7faad6764 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:25.062871 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7e0e1e38-1e13-4ebf-80a6-48b7faad6764 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:25.070868 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7e0e1e38-1e13-4ebf-80a6-48b7faad6764 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:25.071691 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7e0e1e38-1e13-4ebf-80a6-48b7faad6764 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:25.072645 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7e0e1e38-1e13-4ebf-80a6-48b7faad6764 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:25.073331 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7e0e1e38-1e13-4ebf-80a6-48b7faad6764 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:25.656186 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7e0e1e38-1e13-4ebf-80a6-48b7faad6764 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:25.669969 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7e0e1e38-1e13-4ebf-80a6-48b7faad6764 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 0.612421 Feb 28 19:02:25.671143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 50/103] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:25 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:25.681419 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-767a5a6b-2e00-45e1-ab5c-47dca62eaa8b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:25.683000 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-767a5a6b-2e00-45e1-ab5c-47dca62eaa8b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:25.701465 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-767a5a6b-2e00-45e1-ab5c-47dca62eaa8b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:25.702197 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-767a5a6b-2e00-45e1-ab5c-47dca62eaa8b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:25.703238 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-767a5a6b-2e00-45e1-ab5c-47dca62eaa8b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:25.703860 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-767a5a6b-2e00-45e1-ab5c-47dca62eaa8b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:25.792296 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-afea9b60-b36b-421f-b64c-ce99ccd7606b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:25.805114 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-afea9b60-b36b-421f-b64c-ce99ccd7606b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:25.807876 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-afea9b60-b36b-421f-b64c-ce99ccd7606b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:25.809275 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-afea9b60-b36b-421f-b64c-ce99ccd7606b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.777567 Feb 28 19:02:25.821605 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 54/104] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:25 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:26.018137 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-767a5a6b-2e00-45e1-ab5c-47dca62eaa8b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:26.026871 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-767a5a6b-2e00-45e1-ab5c-47dca62eaa8b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.352819 Feb 28 19:02:26.027797 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 51/105] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:25 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:26.703447 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b11c2405-5326-4231-a2bf-6d9082a6484d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:26.703447 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b11c2405-5326-4231-a2bf-6d9082a6484d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:26.710615 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b11c2405-5326-4231-a2bf-6d9082a6484d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:26.711068 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b11c2405-5326-4231-a2bf-6d9082a6484d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:26.711921 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b11c2405-5326-4231-a2bf-6d9082a6484d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:26.712312 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b11c2405-5326-4231-a2bf-6d9082a6484d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:26.830801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d9049430-35f9-4249-bc16-c65ea7268c33 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:26.832141 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d9049430-35f9-4249-bc16-c65ea7268c33 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:26.842032 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d9049430-35f9-4249-bc16-c65ea7268c33 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:26.843047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d9049430-35f9-4249-bc16-c65ea7268c33 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:26.844105 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d9049430-35f9-4249-bc16-c65ea7268c33 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:26.844599 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d9049430-35f9-4249-bc16-c65ea7268c33 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:27.300479 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b11c2405-5326-4231-a2bf-6d9082a6484d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:27.316581 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b11c2405-5326-4231-a2bf-6d9082a6484d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 0.626935 Feb 28 19:02:27.326263 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 55/106] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:26 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:27.333459 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d9049430-35f9-4249-bc16-c65ea7268c33 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:27.335356 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d5cb2096-84da-4569-af4d-0c763d263bc4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:27.336176 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d5cb2096-84da-4569-af4d-0c763d263bc4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:27.342548 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d9049430-35f9-4249-bc16-c65ea7268c33 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:27.344057 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d5cb2096-84da-4569-af4d-0c763d263bc4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:27.358371 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d9049430-35f9-4249-bc16-c65ea7268c33 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:27.358537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d5cb2096-84da-4569-af4d-0c763d263bc4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:27.358618 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d9049430-35f9-4249-bc16-c65ea7268c33 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.518461 Feb 28 19:02:27.358696 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d5cb2096-84da-4569-af4d-0c763d263bc4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:27.358696 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d5cb2096-84da-4569-af4d-0c763d263bc4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:27.358832 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 52/107] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:26 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:27.358832 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-702eda25-2cbb-4f67-bd89-1b5e3cf418c5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4100c304-f6d6-4815-84b3-fab26503479e"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:27.358832 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-702eda25-2cbb-4f67-bd89-1b5e3cf418c5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:27.360055 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-702eda25-2cbb-4f67-bd89-1b5e3cf418c5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:27.360672 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-702eda25-2cbb-4f67-bd89-1b5e3cf418c5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:27.361458 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-702eda25-2cbb-4f67-bd89-1b5e3cf418c5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:27.361893 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-702eda25-2cbb-4f67-bd89-1b5e3cf418c5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:27.620648 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d5cb2096-84da-4569-af4d-0c763d263bc4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:27.630708 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d5cb2096-84da-4569-af4d-0c763d263bc4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.302994 Feb 28 19:02:27.631390 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 56/108] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:27 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:27.908311 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c6205567-30aa-4a50-95f5-6d23879eb84d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49b66d02-5e71-4194-a79b-e408ba96482f"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:27.909418 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c6205567-30aa-4a50-95f5-6d23879eb84d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:27.927849 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c6205567-30aa-4a50-95f5-6d23879eb84d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:27.928298 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c6205567-30aa-4a50-95f5-6d23879eb84d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:27.931522 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c6205567-30aa-4a50-95f5-6d23879eb84d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:27.931974 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c6205567-30aa-4a50-95f5-6d23879eb84d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:28.624525 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-702eda25-2cbb-4f67-bd89-1b5e3cf418c5 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "POST /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.277612 Feb 28 19:02:28.625834 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 53/109] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:02:27 2022] POST /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39/os-volume_attachments => generated 194 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:28.631478 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-03fce8fc-7541-4cdc-8c73-4cc4479dc8a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:28.632611 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-03fce8fc-7541-4cdc-8c73-4cc4479dc8a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:28.640573 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-03fce8fc-7541-4cdc-8c73-4cc4479dc8a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:28.641370 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-03fce8fc-7541-4cdc-8c73-4cc4479dc8a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:28.642890 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-03fce8fc-7541-4cdc-8c73-4cc4479dc8a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:28.643694 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-03fce8fc-7541-4cdc-8c73-4cc4479dc8a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:29.078797 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-03fce8fc-7541-4cdc-8c73-4cc4479dc8a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:29.087395 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-03fce8fc-7541-4cdc-8c73-4cc4479dc8a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1322 microversion: 2.1 time: 0.460160 Feb 28 19:02:29.087894 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 54/110] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:28 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:29.093168 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c0223a27-6b7f-4155-af96-4cd043077954 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:29.093778 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c0223a27-6b7f-4155-af96-4cd043077954 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:29.112487 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c0223a27-6b7f-4155-af96-4cd043077954 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:29.112947 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c0223a27-6b7f-4155-af96-4cd043077954 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:29.113738 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c0223a27-6b7f-4155-af96-4cd043077954 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:29.114311 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c0223a27-6b7f-4155-af96-4cd043077954 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:29.341917 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c0223a27-6b7f-4155-af96-4cd043077954 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:29.350887 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c0223a27-6b7f-4155-af96-4cd043077954 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:29.352511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c0223a27-6b7f-4155-af96-4cd043077954 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:29.353755 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c0223a27-6b7f-4155-af96-4cd043077954 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.264225 Feb 28 19:02:29.358486 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 55/111] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:29 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:29.359377 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-50d0ceaa-9131-45ce-bbf9-567538e8102f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:29.360026 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-50d0ceaa-9131-45ce-bbf9-567538e8102f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:29.367332 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50d0ceaa-9131-45ce-bbf9-567538e8102f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:29.367770 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50d0ceaa-9131-45ce-bbf9-567538e8102f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:29.368542 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50d0ceaa-9131-45ce-bbf9-567538e8102f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:29.368971 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50d0ceaa-9131-45ce-bbf9-567538e8102f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:29.578029 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-50d0ceaa-9131-45ce-bbf9-567538e8102f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:29.586469 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-50d0ceaa-9131-45ce-bbf9-567538e8102f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.230466 Feb 28 19:02:29.587259 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 56/112] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:29 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:30.105082 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7f20a4d4-67b5-40a9-9238-a4e06e8abc69 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:30.106167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7f20a4d4-67b5-40a9-9238-a4e06e8abc69 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:30.113523 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f20a4d4-67b5-40a9-9238-a4e06e8abc69 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:30.115915 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f20a4d4-67b5-40a9-9238-a4e06e8abc69 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:30.115915 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f20a4d4-67b5-40a9-9238-a4e06e8abc69 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:30.115915 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7f20a4d4-67b5-40a9-9238-a4e06e8abc69 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:30.368409 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c6205567-30aa-4a50-95f5-6d23879eb84d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "POST /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.463433 Feb 28 19:02:30.377733 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 57/113] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:02:27 2022] POST /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6/os-volume_attachments => generated 194 bytes in 2475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:30.384770 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7f20a4d4-67b5-40a9-9238-a4e06e8abc69 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:30.387289 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4ab5590a-cdf2-4c08-97e7-b783fa9f6c3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:30.391405 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4ab5590a-cdf2-4c08-97e7-b783fa9f6c3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:30.394693 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7f20a4d4-67b5-40a9-9238-a4e06e8abc69 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1515 microversion: 2.1 time: 0.294032 Feb 28 19:02:30.395307 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 57/114] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:30 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:30.405176 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4ab5590a-cdf2-4c08-97e7-b783fa9f6c3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:30.405176 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4ab5590a-cdf2-4c08-97e7-b783fa9f6c3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:30.405176 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4ab5590a-cdf2-4c08-97e7-b783fa9f6c3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:30.405176 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4ab5590a-cdf2-4c08-97e7-b783fa9f6c3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:30.414326 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b420373b-d7e8-4d63-a571-61ad58374be0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:30.414504 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b420373b-d7e8-4d63-a571-61ad58374be0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:30.423020 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b420373b-d7e8-4d63-a571-61ad58374be0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:30.423766 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b420373b-d7e8-4d63-a571-61ad58374be0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:30.424511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b420373b-d7e8-4d63-a571-61ad58374be0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:30.425000 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b420373b-d7e8-4d63-a571-61ad58374be0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:30.486166 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-b420373b-d7e8-4d63-a571-61ad58374be0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lazy-loading 'flavor' on Instance uuid d8550549-20dd-427f-a2aa-0c06fc252947 {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:02:30.628213 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4ab5590a-cdf2-4c08-97e7-b783fa9f6c3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:30.641122 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4ab5590a-cdf2-4c08-97e7-b783fa9f6c3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:30.642818 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4ab5590a-cdf2-4c08-97e7-b783fa9f6c3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:30.644034 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4ab5590a-cdf2-4c08-97e7-b783fa9f6c3e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.263713 Feb 28 19:02:30.644981 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 58/115] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:30 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:30.649240 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0a0acb5d-dda5-406a-8d14-ac7e93bbad98 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:30.650235 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0a0acb5d-dda5-406a-8d14-ac7e93bbad98 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:30.658733 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a0acb5d-dda5-406a-8d14-ac7e93bbad98 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:30.665245 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a0acb5d-dda5-406a-8d14-ac7e93bbad98 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:30.665245 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a0acb5d-dda5-406a-8d14-ac7e93bbad98 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:30.665245 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a0acb5d-dda5-406a-8d14-ac7e93bbad98 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:30.872977 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0a0acb5d-dda5-406a-8d14-ac7e93bbad98 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:30.888275 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0a0acb5d-dda5-406a-8d14-ac7e93bbad98 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.235722 Feb 28 19:02:30.888275 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 59/116] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:30 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:30.922096 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b420373b-d7e8-4d63-a571-61ad58374be0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "POST /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947/action" status: 200 len: 32 microversion: 2.1 time: 0.512431 Feb 28 19:02:30.923170 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 58/117] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:02:30 2022] POST /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947/action => generated 32 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 19:02:30.933008 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0f5e86cf-35ea-4857-8212-7df2a49f7038 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:30.935369 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0f5e86cf-35ea-4857-8212-7df2a49f7038 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:30.950046 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0f5e86cf-35ea-4857-8212-7df2a49f7038 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:30.955279 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0f5e86cf-35ea-4857-8212-7df2a49f7038 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:30.955279 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0f5e86cf-35ea-4857-8212-7df2a49f7038 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:30.955279 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0f5e86cf-35ea-4857-8212-7df2a49f7038 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:31.227882 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0f5e86cf-35ea-4857-8212-7df2a49f7038 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:31.237123 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0f5e86cf-35ea-4857-8212-7df2a49f7038 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.309037 Feb 28 19:02:31.237705 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 60/118] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:30 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:31.663256 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e647dde6-1045-4ecf-b89e-a748d895ca0f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:31.663957 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e647dde6-1045-4ecf-b89e-a748d895ca0f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:31.673610 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e647dde6-1045-4ecf-b89e-a748d895ca0f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:31.674265 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e647dde6-1045-4ecf-b89e-a748d895ca0f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:31.675219 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e647dde6-1045-4ecf-b89e-a748d895ca0f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:31.675832 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e647dde6-1045-4ecf-b89e-a748d895ca0f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:31.898268 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-63930abc-7519-4fa5-a281-d1f236f11b0b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:31.899124 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-63930abc-7519-4fa5-a281-d1f236f11b0b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:31.907467 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-63930abc-7519-4fa5-a281-d1f236f11b0b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:31.908045 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-63930abc-7519-4fa5-a281-d1f236f11b0b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:31.909061 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-63930abc-7519-4fa5-a281-d1f236f11b0b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:31.909690 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-63930abc-7519-4fa5-a281-d1f236f11b0b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:31.998563 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e647dde6-1045-4ecf-b89e-a748d895ca0f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:32.007602 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e647dde6-1045-4ecf-b89e-a748d895ca0f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:32.009448 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e647dde6-1045-4ecf-b89e-a748d895ca0f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:32.010173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e647dde6-1045-4ecf-b89e-a748d895ca0f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.351567 Feb 28 19:02:32.022782 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 59/119] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:31 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:32.180093 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-63930abc-7519-4fa5-a281-d1f236f11b0b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:32.188804 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-63930abc-7519-4fa5-a281-d1f236f11b0b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.294528 Feb 28 19:02:32.189400 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 61/120] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:31 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:32.254910 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6572c10a-d5a3-4ba3-8ee0-12da7e2e9ec7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:32.256497 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6572c10a-d5a3-4ba3-8ee0-12da7e2e9ec7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:32.265054 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6572c10a-d5a3-4ba3-8ee0-12da7e2e9ec7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:32.265559 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6572c10a-d5a3-4ba3-8ee0-12da7e2e9ec7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:32.266602 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6572c10a-d5a3-4ba3-8ee0-12da7e2e9ec7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:32.267196 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6572c10a-d5a3-4ba3-8ee0-12da7e2e9ec7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:32.477846 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6572c10a-d5a3-4ba3-8ee0-12da7e2e9ec7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:32.495889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6572c10a-d5a3-4ba3-8ee0-12da7e2e9ec7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.244776 Feb 28 19:02:32.497499 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 60/121] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:32 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:33.029033 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5aef8628-e014-4755-828e-37c3c2802270 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:33.029647 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5aef8628-e014-4755-828e-37c3c2802270 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:33.036760 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5aef8628-e014-4755-828e-37c3c2802270 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:33.037205 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5aef8628-e014-4755-828e-37c3c2802270 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:33.037976 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5aef8628-e014-4755-828e-37c3c2802270 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:33.038410 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5aef8628-e014-4755-828e-37c3c2802270 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:33.204922 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fcf1278a-8360-4d34-ab68-97afa29858b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:33.205536 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-fcf1278a-8360-4d34-ab68-97afa29858b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:33.213091 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fcf1278a-8360-4d34-ab68-97afa29858b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:33.213540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fcf1278a-8360-4d34-ab68-97afa29858b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:33.214433 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fcf1278a-8360-4d34-ab68-97afa29858b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:33.214869 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fcf1278a-8360-4d34-ab68-97afa29858b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:33.238296 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5aef8628-e014-4755-828e-37c3c2802270 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:33.247442 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5aef8628-e014-4755-828e-37c3c2802270 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:33.248940 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5aef8628-e014-4755-828e-37c3c2802270 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:33.250008 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5aef8628-e014-4755-828e-37c3c2802270 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.225316 Feb 28 19:02:33.250563 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 62/122] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:33 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:33.418191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fcf1278a-8360-4d34-ab68-97afa29858b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:33.426572 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-fcf1278a-8360-4d34-ab68-97afa29858b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.225363 Feb 28 19:02:33.427160 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 61/123] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:33 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:33.514218 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8de6a4d7-484f-43aa-aae2-b33dbdf779e1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:33.514839 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8de6a4d7-484f-43aa-aae2-b33dbdf779e1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:33.523258 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8de6a4d7-484f-43aa-aae2-b33dbdf779e1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:33.523739 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8de6a4d7-484f-43aa-aae2-b33dbdf779e1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:33.524483 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8de6a4d7-484f-43aa-aae2-b33dbdf779e1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:33.524923 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8de6a4d7-484f-43aa-aae2-b33dbdf779e1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:33.648039 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-4c670310-8ab0-4048-83b5-5e700ec24490 req-6e5dfb84-fc1d-4d6d-a320-e3b39807b0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70", "name": "network-vif-plugged", "status": "completed", "tag": "7caa3a37-72ae-4e36-90cf-0f518cb19c37"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:33.650860 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:33.650860 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:02:33.659882 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-4c670310-8ab0-4048-83b5-5e700ec24490 req-6e5dfb84-fc1d-4d6d-a320-e3b39807b0d6 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:33.660444 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-4c670310-8ab0-4048-83b5-5e700ec24490 req-6e5dfb84-fc1d-4d6d-a320-e3b39807b0d6 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:33.677474 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-4c670310-8ab0-4048-83b5-5e700ec24490 req-6e5dfb84-fc1d-4d6d-a320-e3b39807b0d6 service nova] Creating event network-vif-plugged:7caa3a37-72ae-4e36-90cf-0f518cb19c37 for instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 on hv-cinder-83118 Feb 28 19:02:33.683214 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-4c670310-8ab0-4048-83b5-5e700ec24490 req-6e5dfb84-fc1d-4d6d-a320-e3b39807b0d6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039619 Feb 28 19:02:33.684048 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 62/124] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:02:33.801415 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8de6a4d7-484f-43aa-aae2-b33dbdf779e1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:33.810568 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8de6a4d7-484f-43aa-aae2-b33dbdf779e1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.300512 Feb 28 19:02:33.811293 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 63/125] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:33 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:34.272947 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f29b60fb-7a62-4d7a-9f8f-ee48eedce5a5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:34.273788 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f29b60fb-7a62-4d7a-9f8f-ee48eedce5a5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:34.281960 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f29b60fb-7a62-4d7a-9f8f-ee48eedce5a5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:34.282531 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f29b60fb-7a62-4d7a-9f8f-ee48eedce5a5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:34.283457 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f29b60fb-7a62-4d7a-9f8f-ee48eedce5a5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:34.283985 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f29b60fb-7a62-4d7a-9f8f-ee48eedce5a5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:34.444381 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ae7a54d4-06a2-4c49-912c-efe7bb8151b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:34.445062 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ae7a54d4-06a2-4c49-912c-efe7bb8151b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:34.453207 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ae7a54d4-06a2-4c49-912c-efe7bb8151b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:34.453747 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ae7a54d4-06a2-4c49-912c-efe7bb8151b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:34.454849 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ae7a54d4-06a2-4c49-912c-efe7bb8151b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:34.455537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ae7a54d4-06a2-4c49-912c-efe7bb8151b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:34.491108 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f29b60fb-7a62-4d7a-9f8f-ee48eedce5a5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:34.502552 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f29b60fb-7a62-4d7a-9f8f-ee48eedce5a5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:34.504251 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f29b60fb-7a62-4d7a-9f8f-ee48eedce5a5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:34.505730 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f29b60fb-7a62-4d7a-9f8f-ee48eedce5a5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.237156 Feb 28 19:02:34.506379 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 63/126] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:34 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:34.660585 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ae7a54d4-06a2-4c49-912c-efe7bb8151b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:34.669577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ae7a54d4-06a2-4c49-912c-efe7bb8151b3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.229322 Feb 28 19:02:34.679474 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 64/127] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:34 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:34.829174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7d7d9952-2e89-45fc-88ce-ccb40d163dd2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:34.829829 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7d7d9952-2e89-45fc-88ce-ccb40d163dd2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:34.837309 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d7d9952-2e89-45fc-88ce-ccb40d163dd2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:34.837757 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d7d9952-2e89-45fc-88ce-ccb40d163dd2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:34.838667 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d7d9952-2e89-45fc-88ce-ccb40d163dd2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:34.839160 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d7d9952-2e89-45fc-88ce-ccb40d163dd2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:35.034543 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7d7d9952-2e89-45fc-88ce-ccb40d163dd2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:35.043308 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7d7d9952-2e89-45fc-88ce-ccb40d163dd2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.217843 Feb 28 19:02:35.043869 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 64/128] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:34 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:35.526688 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4f6598ac-8cb8-4446-bc3b-902b32be24d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:35.527447 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4f6598ac-8cb8-4446-bc3b-902b32be24d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:35.534476 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4f6598ac-8cb8-4446-bc3b-902b32be24d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:35.534917 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4f6598ac-8cb8-4446-bc3b-902b32be24d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:35.535714 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4f6598ac-8cb8-4446-bc3b-902b32be24d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:35.536148 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4f6598ac-8cb8-4446-bc3b-902b32be24d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:35.694521 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4a23364c-50f0-4f75-8ac5-ef6db55d1385 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:35.695883 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4a23364c-50f0-4f75-8ac5-ef6db55d1385 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:35.703991 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4a23364c-50f0-4f75-8ac5-ef6db55d1385 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:35.704680 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4a23364c-50f0-4f75-8ac5-ef6db55d1385 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:35.705740 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4a23364c-50f0-4f75-8ac5-ef6db55d1385 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:35.706377 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4a23364c-50f0-4f75-8ac5-ef6db55d1385 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:35.895395 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4f6598ac-8cb8-4446-bc3b-902b32be24d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:35.909622 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4f6598ac-8cb8-4446-bc3b-902b32be24d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:35.911140 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4f6598ac-8cb8-4446-bc3b-902b32be24d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:35.917525 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4f6598ac-8cb8-4446-bc3b-902b32be24d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1408 microversion: 2.20 time: 0.395102 Feb 28 19:02:35.920116 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 65/129] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:35 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1408 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:35.979435 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-85ac1134-10b9-43c0-ace1-98e6039e0d52 req-b733a6f4-be0d-4a6d-b18f-36cb5239f97e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45883a52-0422-4de3-b428-d6f24780b283", "name": "network-vif-plugged", "status": "completed", "tag": "f30d713e-926a-4637-924b-eabbced9f31c"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:35.981489 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:35.981489 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:02:35.990055 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-85ac1134-10b9-43c0-ace1-98e6039e0d52 req-b733a6f4-be0d-4a6d-b18f-36cb5239f97e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:35.990625 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-85ac1134-10b9-43c0-ace1-98e6039e0d52 req-b733a6f4-be0d-4a6d-b18f-36cb5239f97e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:36.005368 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4a23364c-50f0-4f75-8ac5-ef6db55d1385 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:36.008802 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-85ac1134-10b9-43c0-ace1-98e6039e0d52 req-b733a6f4-be0d-4a6d-b18f-36cb5239f97e service nova] Creating event network-vif-plugged:f30d713e-926a-4637-924b-eabbced9f31c for instance 45883a52-0422-4de3-b428-d6f24780b283 on hv-cinder-83118 Feb 28 19:02:36.014587 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-85ac1134-10b9-43c0-ace1-98e6039e0d52 req-b733a6f4-be0d-4a6d-b18f-36cb5239f97e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038862 Feb 28 19:02:36.014713 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4a23364c-50f0-4f75-8ac5-ef6db55d1385 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.324512 Feb 28 19:02:36.015652 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 65/130] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:35 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:36.019627 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 66/131] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:02:36.059671 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-49863581-d48b-48e9-9631-f9b129302a93 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:36.060681 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-49863581-d48b-48e9-9631-f9b129302a93 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:36.074455 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49863581-d48b-48e9-9631-f9b129302a93 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:36.078168 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49863581-d48b-48e9-9631-f9b129302a93 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:36.081349 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49863581-d48b-48e9-9631-f9b129302a93 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:36.082078 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49863581-d48b-48e9-9631-f9b129302a93 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:36.343653 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-49863581-d48b-48e9-9631-f9b129302a93 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:36.361597 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-49863581-d48b-48e9-9631-f9b129302a93 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.305242 Feb 28 19:02:36.363514 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 66/132] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:36 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:36.938353 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d3e8b825-0278-40c4-97d3-22e5d988cb8f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:36.939079 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d3e8b825-0278-40c4-97d3-22e5d988cb8f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:36.946458 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3e8b825-0278-40c4-97d3-22e5d988cb8f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:36.946906 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3e8b825-0278-40c4-97d3-22e5d988cb8f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:36.947723 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3e8b825-0278-40c4-97d3-22e5d988cb8f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:36.948733 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3e8b825-0278-40c4-97d3-22e5d988cb8f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:37.033253 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-73921fce-226d-480c-8f44-a7a2b04c6402 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:37.033865 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-73921fce-226d-480c-8f44-a7a2b04c6402 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:37.045698 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-73921fce-226d-480c-8f44-a7a2b04c6402 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:37.046148 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-73921fce-226d-480c-8f44-a7a2b04c6402 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:37.047195 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-73921fce-226d-480c-8f44-a7a2b04c6402 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:37.047619 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-73921fce-226d-480c-8f44-a7a2b04c6402 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:37.219417 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d3e8b825-0278-40c4-97d3-22e5d988cb8f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:37.228333 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d3e8b825-0278-40c4-97d3-22e5d988cb8f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:37.230674 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d3e8b825-0278-40c4-97d3-22e5d988cb8f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:37.231900 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d3e8b825-0278-40c4-97d3-22e5d988cb8f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1601 microversion: 2.20 time: 0.297800 Feb 28 19:02:37.245912 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 67/133] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:02:36 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1601 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:02:37.252314 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8c490df9-5703-4de1-adf8-28c2827d3e64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:37.253986 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8c490df9-5703-4de1-adf8-28c2827d3e64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:37.263202 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c490df9-5703-4de1-adf8-28c2827d3e64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:37.264125 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c490df9-5703-4de1-adf8-28c2827d3e64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:37.265070 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c490df9-5703-4de1-adf8-28c2827d3e64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:37.265666 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c490df9-5703-4de1-adf8-28c2827d3e64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:37.375522 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-73921fce-226d-480c-8f44-a7a2b04c6402 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:37.386514 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-73921fce-226d-480c-8f44-a7a2b04c6402 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.356540 Feb 28 19:02:37.388229 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 67/134] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:37 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:37.401945 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-5e30d397-5280-4010-acf7-5a5809992803 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:37.402674 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5e30d397-5280-4010-acf7-5a5809992803 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:37.410408 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5e30d397-5280-4010-acf7-5a5809992803 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:37.410570 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5e30d397-5280-4010-acf7-5a5809992803 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:37.411836 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5e30d397-5280-4010-acf7-5a5809992803 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:37.412440 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5e30d397-5280-4010-acf7-5a5809992803 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:37.480563 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8c490df9-5703-4de1-adf8-28c2827d3e64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.232939 Feb 28 19:02:37.487634 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 68/135] 10.222.0.21 () {60 vars in 1315 bytes} [Mon Feb 28 19:02:37 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 19:02:38.031443 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-5e30d397-5280-4010-acf7-5a5809992803 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:38.067102 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-5e30d397-5280-4010-acf7-5a5809992803 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.677353 Feb 28 19:02:38.073453 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 68/136] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:37 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:38.405457 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-843d52e3-2279-495d-ba8a-50587dd5d22a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:38.406072 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-843d52e3-2279-495d-ba8a-50587dd5d22a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:38.413404 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-843d52e3-2279-495d-ba8a-50587dd5d22a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:38.413855 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-843d52e3-2279-495d-ba8a-50587dd5d22a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:38.414725 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-843d52e3-2279-495d-ba8a-50587dd5d22a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:38.415185 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-843d52e3-2279-495d-ba8a-50587dd5d22a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:38.806335 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-843d52e3-2279-495d-ba8a-50587dd5d22a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:38.815200 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-843d52e3-2279-495d-ba8a-50587dd5d22a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1362 microversion: 2.1 time: 0.414300 Feb 28 19:02:38.824501 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 69/137] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:38 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:39.088958 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fa72d123-a3f8-426f-8827-c40460520442 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:39.090351 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-fa72d123-a3f8-426f-8827-c40460520442 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:39.100680 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fa72d123-a3f8-426f-8827-c40460520442 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:39.101348 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fa72d123-a3f8-426f-8827-c40460520442 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:39.102690 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fa72d123-a3f8-426f-8827-c40460520442 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:39.103377 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fa72d123-a3f8-426f-8827-c40460520442 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:39.637972 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fa72d123-a3f8-426f-8827-c40460520442 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:39.649101 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-fa72d123-a3f8-426f-8827-c40460520442 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.563024 Feb 28 19:02:39.649101 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 69/138] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:39 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:39.835078 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-308da31d-3c95-40e2-9ad1-bc69e79415ae tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:39.835810 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-308da31d-3c95-40e2-9ad1-bc69e79415ae tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:39.847669 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-308da31d-3c95-40e2-9ad1-bc69e79415ae tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:39.848375 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-308da31d-3c95-40e2-9ad1-bc69e79415ae tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:39.849666 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-308da31d-3c95-40e2-9ad1-bc69e79415ae tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:39.850367 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-308da31d-3c95-40e2-9ad1-bc69e79415ae tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:39.864735 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-99a310da-0de9-4001-8494-a5164fce5463 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:39.865587 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-99a310da-0de9-4001-8494-a5164fce5463 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:39.878193 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-99a310da-0de9-4001-8494-a5164fce5463 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:39.878641 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-99a310da-0de9-4001-8494-a5164fce5463 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:39.892047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-99a310da-0de9-4001-8494-a5164fce5463 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:39.892485 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-99a310da-0de9-4001-8494-a5164fce5463 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:39.953347 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-99a310da-0de9-4001-8494-a5164fce5463 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/ips" status: 200 len: 113 microversion: 2.20 time: 0.093150 Feb 28 19:02:39.954577 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 70/139] 10.222.0.21 () {60 vars in 1288 bytes} [Mon Feb 28 19:02:39 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/ips => generated 113 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 19:02:39.969617 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-4f3609b1-6fa4-49e4-86e8-e5858cbf85c8 req-7d7ada20-4fa4-47da-b0ba-82436a44bc15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70", "tag": "7caa3a37-72ae-4e36-90cf-0f518cb19c37"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:39.969617 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:39.969617 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:02:39.988760 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-4f3609b1-6fa4-49e4-86e8-e5858cbf85c8 req-7d7ada20-4fa4-47da-b0ba-82436a44bc15 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:39.992625 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-4f3609b1-6fa4-49e4-86e8-e5858cbf85c8 req-7d7ada20-4fa4-47da-b0ba-82436a44bc15 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:40.015030 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-4f3609b1-6fa4-49e4-86e8-e5858cbf85c8 req-7d7ada20-4fa4-47da-b0ba-82436a44bc15 service nova] Creating event network-changed:7caa3a37-72ae-4e36-90cf-0f518cb19c37 for instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 on hv-cinder-83118 Feb 28 19:02:40.023293 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-4f3609b1-6fa4-49e4-86e8-e5858cbf85c8 req-7d7ada20-4fa4-47da-b0ba-82436a44bc15 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064475 Feb 28 19:02:40.023293 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 71/140] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:40.243962 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-308da31d-3c95-40e2-9ad1-bc69e79415ae tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:40.252687 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-308da31d-3c95-40e2-9ad1-bc69e79415ae tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1547 microversion: 2.1 time: 0.424276 Feb 28 19:02:40.253351 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 70/141] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:39 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1547 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:40.271887 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2e7c7d41-7354-4a6d-ad00-6a997b0d354a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:40.276471 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2e7c7d41-7354-4a6d-ad00-6a997b0d354a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:40.281194 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e7c7d41-7354-4a6d-ad00-6a997b0d354a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:40.281706 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e7c7d41-7354-4a6d-ad00-6a997b0d354a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:40.282560 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e7c7d41-7354-4a6d-ad00-6a997b0d354a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:40.283047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e7c7d41-7354-4a6d-ad00-6a997b0d354a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:40.555748 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2e7c7d41-7354-4a6d-ad00-6a997b0d354a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.288228 Feb 28 19:02:40.556574 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 72/142] 10.222.0.21 () {58 vars in 1274 bytes} [Mon Feb 28 19:02:40 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/os-interface => generated 284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:40.667013 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-844e978d-544f-47b2-b185-f3681ae6e751 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:40.669242 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-844e978d-544f-47b2-b185-f3681ae6e751 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:40.678057 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-844e978d-544f-47b2-b185-f3681ae6e751 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:40.679020 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-844e978d-544f-47b2-b185-f3681ae6e751 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:40.680269 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-844e978d-544f-47b2-b185-f3681ae6e751 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:40.680942 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-844e978d-544f-47b2-b185-f3681ae6e751 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:41.270626 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b8f61c99-8449-4074-8c75-01f0c538f661 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:41.271391 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b8f61c99-8449-4074-8c75-01f0c538f661 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:41.287268 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8f61c99-8449-4074-8c75-01f0c538f661 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:41.288048 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8f61c99-8449-4074-8c75-01f0c538f661 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:41.288551 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8f61c99-8449-4074-8c75-01f0c538f661 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:41.289185 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8f61c99-8449-4074-8c75-01f0c538f661 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:41.384262 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b8f61c99-8449-4074-8c75-01f0c538f661 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Going to try to terminate instance {{(pid=101792) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:02:41.574526 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-844e978d-544f-47b2-b185-f3681ae6e751 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:41.588839 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-844e978d-544f-47b2-b185-f3681ae6e751 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.927652 Feb 28 19:02:41.589701 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 71/143] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:40 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:41.842725 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b8f61c99-8449-4074-8c75-01f0c538f661 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 204 len: 0 microversion: 2.1 time: 0.580756 Feb 28 19:02:41.843677 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 73/144] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:02:41 2022] DELETE /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 28 19:02:41.856737 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-03c66e24-bf59-44b9-b4d8-478abd633184 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:41.856737 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-03c66e24-bf59-44b9-b4d8-478abd633184 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:41.860548 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-03c66e24-bf59-44b9-b4d8-478abd633184 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:41.861109 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-03c66e24-bf59-44b9-b4d8-478abd633184 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:41.861881 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-03c66e24-bf59-44b9-b4d8-478abd633184 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:41.862306 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-03c66e24-bf59-44b9-b4d8-478abd633184 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:42.210322 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-03c66e24-bf59-44b9-b4d8-478abd633184 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:42.219410 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-03c66e24-bf59-44b9-b4d8-478abd633184 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1552 microversion: 2.1 time: 0.371455 Feb 28 19:02:42.229238 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 72/145] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:41 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1552 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:42.609360 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e97548b0-be72-49be-bdef-60788563c5fd tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:42.610068 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e97548b0-be72-49be-bdef-60788563c5fd tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:42.617978 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e97548b0-be72-49be-bdef-60788563c5fd tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:42.618888 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e97548b0-be72-49be-bdef-60788563c5fd tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:42.619286 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e97548b0-be72-49be-bdef-60788563c5fd tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:42.619918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e97548b0-be72-49be-bdef-60788563c5fd tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:43.037283 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-39c1cda5-9ee0-4be8-b95b-ecf452c37672 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:43.038115 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-39c1cda5-9ee0-4be8-b95b-ecf452c37672 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:43.046698 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-39c1cda5-9ee0-4be8-b95b-ecf452c37672 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:43.047310 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-39c1cda5-9ee0-4be8-b95b-ecf452c37672 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:43.048315 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-39c1cda5-9ee0-4be8-b95b-ecf452c37672 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:43.048827 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-39c1cda5-9ee0-4be8-b95b-ecf452c37672 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:43.089508 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e97548b0-be72-49be-bdef-60788563c5fd tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:43.099541 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e97548b0-be72-49be-bdef-60788563c5fd tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.497232 Feb 28 19:02:43.105455 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 74/146] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:42 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:43.106815 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-0f87bad0-235a-482e-8608-e49f86e7c38b req-70905fb6-0687-40c2-89ae-8459f2cc3d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45883a52-0422-4de3-b428-d6f24780b283", "tag": "f30d713e-926a-4637-924b-eabbced9f31c"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:43.108575 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:43.108575 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:02:43.119156 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-0f87bad0-235a-482e-8608-e49f86e7c38b req-70905fb6-0687-40c2-89ae-8459f2cc3d08 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:43.126572 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-0f87bad0-235a-482e-8608-e49f86e7c38b req-70905fb6-0687-40c2-89ae-8459f2cc3d08 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:43.133125 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-39c1cda5-9ee0-4be8-b95b-ecf452c37672 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/ips" status: 200 len: 105 microversion: 2.1 time: 0.099369 Feb 28 19:02:43.133910 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 73/147] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 19:02:43 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/ips => generated 105 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:43.153655 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-0f87bad0-235a-482e-8608-e49f86e7c38b req-70905fb6-0687-40c2-89ae-8459f2cc3d08 service nova] Creating event network-changed:f30d713e-926a-4637-924b-eabbced9f31c for instance 45883a52-0422-4de3-b428-d6f24780b283 on hv-cinder-83118 Feb 28 19:02:43.159206 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-0f87bad0-235a-482e-8608-e49f86e7c38b req-70905fb6-0687-40c2-89ae-8459f2cc3d08 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057308 Feb 28 19:02:43.163013 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 75/148] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:43.236668 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f9a7e392-0724-45f0-99bb-5beab8d410a0 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:43.237590 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f9a7e392-0724-45f0-99bb-5beab8d410a0 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:43.255291 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f9a7e392-0724-45f0-99bb-5beab8d410a0 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:43.258180 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f9a7e392-0724-45f0-99bb-5beab8d410a0 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:43.258180 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f9a7e392-0724-45f0-99bb-5beab8d410a0 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:43.258180 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f9a7e392-0724-45f0-99bb-5beab8d410a0 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:43.806127 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f9a7e392-0724-45f0-99bb-5beab8d410a0 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:43.820248 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f9a7e392-0724-45f0-99bb-5beab8d410a0 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1552 microversion: 2.1 time: 0.587274 Feb 28 19:02:43.821113 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 74/149] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:43 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1552 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:44.122418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6d66f14f-88a8-49e3-8b2f-eac0ccf64104 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:44.123138 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6d66f14f-88a8-49e3-8b2f-eac0ccf64104 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:44.132525 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d66f14f-88a8-49e3-8b2f-eac0ccf64104 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:44.134069 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d66f14f-88a8-49e3-8b2f-eac0ccf64104 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:44.137342 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d66f14f-88a8-49e3-8b2f-eac0ccf64104 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:44.138144 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d66f14f-88a8-49e3-8b2f-eac0ccf64104 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:44.483838 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6d66f14f-88a8-49e3-8b2f-eac0ccf64104 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:44.511228 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6d66f14f-88a8-49e3-8b2f-eac0ccf64104 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.391678 Feb 28 19:02:44.515159 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 76/150] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:44 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:44.838761 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f5545e7b-7924-4067-9118-b255d065260d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:44.840099 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f5545e7b-7924-4067-9118-b255d065260d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:44.854291 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5545e7b-7924-4067-9118-b255d065260d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:44.856372 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5545e7b-7924-4067-9118-b255d065260d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:44.858010 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5545e7b-7924-4067-9118-b255d065260d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:44.858640 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5545e7b-7924-4067-9118-b255d065260d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:45.495237 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f5545e7b-7924-4067-9118-b255d065260d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:45.504402 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f5545e7b-7924-4067-9118-b255d065260d tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1552 microversion: 2.1 time: 0.670404 Feb 28 19:02:45.505280 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 75/151] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:44 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1552 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:45.527765 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fef9324d-671a-4490-93fd-70d1e920036f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:45.528982 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-fef9324d-671a-4490-93fd-70d1e920036f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:45.538701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fef9324d-671a-4490-93fd-70d1e920036f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:45.539165 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fef9324d-671a-4490-93fd-70d1e920036f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:45.539930 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fef9324d-671a-4490-93fd-70d1e920036f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:45.540359 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fef9324d-671a-4490-93fd-70d1e920036f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:45.866167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fef9324d-671a-4490-93fd-70d1e920036f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:45.874992 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-fef9324d-671a-4490-93fd-70d1e920036f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.351846 Feb 28 19:02:45.875600 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 77/152] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:45 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:45.996683 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-6e2b090f-4a44-4fd5-aaea-4e4d13145101 req-8b6616ac-167d-4295-b0ee-4fbf4fe8d1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7419a104-ba80-4043-87e2-b565459c6f39", "name": "network-vif-deleted", "tag": "32302e0f-82da-4b80-902d-b422d9d231e1"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:45.998228 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:45.998228 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:02:46.006980 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-6e2b090f-4a44-4fd5-aaea-4e4d13145101 req-8b6616ac-167d-4295-b0ee-4fbf4fe8d1e0 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:46.007485 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-6e2b090f-4a44-4fd5-aaea-4e4d13145101 req-8b6616ac-167d-4295-b0ee-4fbf4fe8d1e0 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:46.025901 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-6e2b090f-4a44-4fd5-aaea-4e4d13145101 req-8b6616ac-167d-4295-b0ee-4fbf4fe8d1e0 service nova] Creating event network-vif-deleted:32302e0f-82da-4b80-902d-b422d9d231e1 for instance 7419a104-ba80-4043-87e2-b565459c6f39 on hv-cinder-83118 Feb 28 19:02:46.030876 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-6e2b090f-4a44-4fd5-aaea-4e4d13145101 req-8b6616ac-167d-4295-b0ee-4fbf4fe8d1e0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038046 Feb 28 19:02:46.032052 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 76/153] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:46.522365 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e7946109-c7c2-4aac-8385-f1cc00afbc4e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:46.523060 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e7946109-c7c2-4aac-8385-f1cc00afbc4e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:46.530399 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7946109-c7c2-4aac-8385-f1cc00afbc4e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:46.530992 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7946109-c7c2-4aac-8385-f1cc00afbc4e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:46.531655 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7946109-c7c2-4aac-8385-f1cc00afbc4e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:46.532088 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7946109-c7c2-4aac-8385-f1cc00afbc4e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:46.783336 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e7946109-c7c2-4aac-8385-f1cc00afbc4e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:46.793706 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e7946109-c7c2-4aac-8385-f1cc00afbc4e tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1345 microversion: 2.1 time: 0.275808 Feb 28 19:02:46.794488 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 78/154] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:46 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1345 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:46.892108 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6c8231cc-790f-45fe-a87f-7a33f3ab3d5f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:46.892790 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-6c8231cc-790f-45fe-a87f-7a33f3ab3d5f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:46.900031 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6c8231cc-790f-45fe-a87f-7a33f3ab3d5f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:46.900545 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6c8231cc-790f-45fe-a87f-7a33f3ab3d5f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:46.909420 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6c8231cc-790f-45fe-a87f-7a33f3ab3d5f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:46.909420 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6c8231cc-790f-45fe-a87f-7a33f3ab3d5f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:47.106387 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6c8231cc-790f-45fe-a87f-7a33f3ab3d5f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:47.115705 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6c8231cc-790f-45fe-a87f-7a33f3ab3d5f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.227626 Feb 28 19:02:47.116263 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 77/155] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:46 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:47.810796 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-61d3295a-06dd-4360-b1c1-2b240c8a1e61 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:47.811430 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-61d3295a-06dd-4360-b1c1-2b240c8a1e61 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:47.822255 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-61d3295a-06dd-4360-b1c1-2b240c8a1e61 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:47.827394 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-655050299", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "networks": [{"uuid": "449788a3-ff13-44f6-8b3b-66a4d81bb7d5"}]}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:47.829662 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-61d3295a-06dd-4360-b1c1-2b240c8a1e61 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:47.830438 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-61d3295a-06dd-4360-b1c1-2b240c8a1e61 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:47.830911 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-61d3295a-06dd-4360-b1c1-2b240c8a1e61 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:47.929006 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.network.neutron [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] validate_networks() for [('449788a3-ff13-44f6-8b3b-66a4d81bb7d5', None, None, None)] {{(pid=101791) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:02:47.942988 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-61d3295a-06dd-4360-b1c1-2b240c8a1e61 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:47.943477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-61d3295a-06dd-4360-b1c1-2b240c8a1e61 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:47.944287 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-61d3295a-06dd-4360-b1c1-2b240c8a1e61 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lazy-loading 'fault' on Instance uuid 7419a104-ba80-4043-87e2-b565459c6f39 {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:02:48.051369 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-61d3295a-06dd-4360-b1c1-2b240c8a1e61 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e4e775395f4f01b37ae1e6efe87898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2234b3391e204ea49d8e31d3731b822c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:48.059688 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-61d3295a-06dd-4360-b1c1-2b240c8a1e61 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 200 len: 1304 microversion: 2.1 time: 0.252644 Feb 28 19:02:48.060626 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 79/156] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:47 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 1304 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:48.131977 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e3e03e20-a822-45a8-9485-be2f85de43e4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:48.133064 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e3e03e20-a822-45a8-9485-be2f85de43e4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:48.141388 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e3e03e20-a822-45a8-9485-be2f85de43e4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:48.142102 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e3e03e20-a822-45a8-9485-be2f85de43e4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:48.142897 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e3e03e20-a822-45a8-9485-be2f85de43e4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:48.143566 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e3e03e20-a822-45a8-9485-be2f85de43e4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:48.568340 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e3e03e20-a822-45a8-9485-be2f85de43e4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:48.583576 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e3e03e20-a822-45a8-9485-be2f85de43e4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.455085 Feb 28 19:02:48.584363 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 80/157] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:48 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:48.733738 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Flavor limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:02:48.734212 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Image limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:02:48.734768 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Flavor pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:02:48.735242 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Image pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:02:48.735664 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:02:48.744754 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:48.745217 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:48.746022 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:48.746458 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:48.764505 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Getting quotas for project 498eaf5c78e54296ac5cdeef3489e3ef. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:02:48.768482 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Getting quotas for user 46e767d2e3624a3fa799c8c1b20b0516 and project 498eaf5c78e54296ac5cdeef3489e3ef. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:02:48.779709 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Going to run 1 instances... {{(pid=101791) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:02:48.782191 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:02:48.993490 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b7c67aa2-a494-472e-8596-02accad0f8a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171727 Feb 28 19:02:48.994927 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 78/158] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:02:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 28 19:02:49.004647 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-58a1748c-f136-4220-9164-c166bf5d8163 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:49.005258 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-58a1748c-f136-4220-9164-c166bf5d8163 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:49.079786 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-68421133-7db5-42fb-a731-aca38c998270 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:49.080755 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-68421133-7db5-42fb-a731-aca38c998270 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:49.085121 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-58a1748c-f136-4220-9164-c166bf5d8163 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:49.094960 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68421133-7db5-42fb-a731-aca38c998270 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:49.095126 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-58a1748c-f136-4220-9164-c166bf5d8163 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1217 microversion: 2.1 time: 0.094025 Feb 28 19:02:49.095684 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 81/159] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:48 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:49.105354 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68421133-7db5-42fb-a731-aca38c998270 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:49.106287 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68421133-7db5-42fb-a731-aca38c998270 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:49.106742 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68421133-7db5-42fb-a731-aca38c998270 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:49.173777 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-68421133-7db5-42fb-a731-aca38c998270 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] HTTP exception thrown: Instance 7419a104-ba80-4043-87e2-b565459c6f39 could not be found. Feb 28 19:02:49.174345 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-68421133-7db5-42fb-a731-aca38c998270 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Returning 404 to user: Instance 7419a104-ba80-4043-87e2-b565459c6f39 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:02:49.175191 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-68421133-7db5-42fb-a731-aca38c998270 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 404 len: 111 microversion: 2.1 time: 0.099841 Feb 28 19:02:49.178946 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 79/160] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:49 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:02:49.361421 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0f9421cd-92c8-4266-95e6-0c9cc557a6f6 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:49.362466 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0f9421cd-92c8-4266-95e6-0c9cc557a6f6 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:49.373114 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0f9421cd-92c8-4266-95e6-0c9cc557a6f6 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:49.378156 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0f9421cd-92c8-4266-95e6-0c9cc557a6f6 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:49.378156 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0f9421cd-92c8-4266-95e6-0c9cc557a6f6 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:49.378156 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0f9421cd-92c8-4266-95e6-0c9cc557a6f6 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:49.567633 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-0f9421cd-92c8-4266-95e6-0c9cc557a6f6 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] HTTP exception thrown: Instance 7419a104-ba80-4043-87e2-b565459c6f39 could not be found. Feb 28 19:02:49.568241 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0f9421cd-92c8-4266-95e6-0c9cc557a6f6 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Returning 404 to user: Instance 7419a104-ba80-4043-87e2-b565459c6f39 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:02:49.569071 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0f9421cd-92c8-4266-95e6-0c9cc557a6f6 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.211608 Feb 28 19:02:49.569627 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 82/161] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:02:49 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39/os-volume_attachments => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:02:49.601807 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b2da24eb-4ae0-49c9-9ae2-ca4fcd06f33e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:49.602554 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b2da24eb-4ae0-49c9-9ae2-ca4fcd06f33e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:49.611600 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b2da24eb-4ae0-49c9-9ae2-ca4fcd06f33e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:49.612346 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b2da24eb-4ae0-49c9-9ae2-ca4fcd06f33e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:49.613477 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b2da24eb-4ae0-49c9-9ae2-ca4fcd06f33e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:49.614136 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b2da24eb-4ae0-49c9-9ae2-ca4fcd06f33e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:49.870401 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b2da24eb-4ae0-49c9-9ae2-ca4fcd06f33e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:49.878727 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b2da24eb-4ae0-49c9-9ae2-ca4fcd06f33e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.281254 Feb 28 19:02:49.879307 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 80/162] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:49 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:50.112022 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f0c3b8f8-4a15-448c-860b-640ac18bd8b4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:50.112635 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f0c3b8f8-4a15-448c-860b-640ac18bd8b4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:50.121465 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f0c3b8f8-4a15-448c-860b-640ac18bd8b4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:50.121918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f0c3b8f8-4a15-448c-860b-640ac18bd8b4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:50.122701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f0c3b8f8-4a15-448c-860b-640ac18bd8b4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:50.123159 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f0c3b8f8-4a15-448c-860b-640ac18bd8b4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:50.268944 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f0c3b8f8-4a15-448c-860b-640ac18bd8b4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:50.279077 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f0c3b8f8-4a15-448c-860b-640ac18bd8b4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1221 microversion: 2.1 time: 0.170596 Feb 28 19:02:50.279675 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 83/163] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:50 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1221 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:50.895754 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-525f5170-a333-41c6-ad67-9239aaf5f02a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:50.896367 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-525f5170-a333-41c6-ad67-9239aaf5f02a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:50.905048 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-525f5170-a333-41c6-ad67-9239aaf5f02a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:50.905688 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-525f5170-a333-41c6-ad67-9239aaf5f02a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:50.906500 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-525f5170-a333-41c6-ad67-9239aaf5f02a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:50.907293 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-525f5170-a333-41c6-ad67-9239aaf5f02a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:51.153588 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-525f5170-a333-41c6-ad67-9239aaf5f02a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:51.162285 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-525f5170-a333-41c6-ad67-9239aaf5f02a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.270128 Feb 28 19:02:51.162840 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 81/164] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:50 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:51.259174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f9f972da-736b-4425-8ef2-04e0c31c5640 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:51.259742 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f9f972da-736b-4425-8ef2-04e0c31c5640 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:51.268593 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f9f972da-736b-4425-8ef2-04e0c31c5640 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:51.269165 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f9f972da-736b-4425-8ef2-04e0c31c5640 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:51.269958 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f9f972da-736b-4425-8ef2-04e0c31c5640 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:51.270463 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f9f972da-736b-4425-8ef2-04e0c31c5640 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:51.302608 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-13beb09d-bb96-409e-8924-3b566fb70a70 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:51.306448 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-13beb09d-bb96-409e-8924-3b566fb70a70 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:51.326322 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-f9f972da-736b-4425-8ef2-04e0c31c5640 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] HTTP exception thrown: Instance 7419a104-ba80-4043-87e2-b565459c6f39 could not be found. Feb 28 19:02:51.327620 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f9f972da-736b-4425-8ef2-04e0c31c5640 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Returning 404 to user: Instance 7419a104-ba80-4043-87e2-b565459c6f39 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:02:51.328212 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-13beb09d-bb96-409e-8924-3b566fb70a70 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:51.329248 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-13beb09d-bb96-409e-8924-3b566fb70a70 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:51.330429 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-13beb09d-bb96-409e-8924-3b566fb70a70 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:51.331158 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-13beb09d-bb96-409e-8924-3b566fb70a70 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:51.335950 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f9f972da-736b-4425-8ef2-04e0c31c5640 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 404 len: 111 microversion: 2.1 time: 0.073748 Feb 28 19:02:51.338750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 84/165] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:02:51 2022] DELETE /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:02:51.344957 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fd5418c4-2051-4160-8549-ec0b01360303 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:51.345681 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-fd5418c4-2051-4160-8549-ec0b01360303 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] [instance: 7419a104-ba80-4043-87e2-b565459c6f39] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:51.355334 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fd5418c4-2051-4160-8549-ec0b01360303 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:51.356008 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fd5418c4-2051-4160-8549-ec0b01360303 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:51.357208 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fd5418c4-2051-4160-8549-ec0b01360303 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:51.357821 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fd5418c4-2051-4160-8549-ec0b01360303 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:51.417939 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-fd5418c4-2051-4160-8549-ec0b01360303 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] HTTP exception thrown: Instance 7419a104-ba80-4043-87e2-b565459c6f39 could not be found. Feb 28 19:02:51.418659 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fd5418c4-2051-4160-8549-ec0b01360303 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] Returning 404 to user: Instance 7419a104-ba80-4043-87e2-b565459c6f39 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:02:51.419615 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-fd5418c4-2051-4160-8549-ec0b01360303 tempest-DeleteServersTestJSON-976201672 tempest-DeleteServersTestJSON-976201672-project] 10.222.0.21 "GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39" status: 404 len: 111 microversion: 2.1 time: 0.078367 Feb 28 19:02:51.424920 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 85/166] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:51 2022] GET /compute/v2.1/servers/7419a104-ba80-4043-87e2-b565459c6f39 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:02:51.501043 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-13beb09d-bb96-409e-8924-3b566fb70a70 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:51.509859 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-13beb09d-bb96-409e-8924-3b566fb70a70 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1269 microversion: 2.1 time: 0.216625 Feb 28 19:02:51.510428 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 82/167] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:51 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1269 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:52.182947 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7dd45473-7a9a-48a2-ae1a-2897c23bd209 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:52.183358 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7dd45473-7a9a-48a2-ae1a-2897c23bd209 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:52.191505 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7dd45473-7a9a-48a2-ae1a-2897c23bd209 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:52.192266 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7dd45473-7a9a-48a2-ae1a-2897c23bd209 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:52.193252 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7dd45473-7a9a-48a2-ae1a-2897c23bd209 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:52.193908 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7dd45473-7a9a-48a2-ae1a-2897c23bd209 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:52.526073 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-54726c99-5e56-4773-b47f-00b3b7b624ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:52.527973 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-54726c99-5e56-4773-b47f-00b3b7b624ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:52.537671 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-54726c99-5e56-4773-b47f-00b3b7b624ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:52.538223 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-54726c99-5e56-4773-b47f-00b3b7b624ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:52.539056 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-54726c99-5e56-4773-b47f-00b3b7b624ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:52.539571 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-54726c99-5e56-4773-b47f-00b3b7b624ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:52.778391 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-54726c99-5e56-4773-b47f-00b3b7b624ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:52.786407 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-54726c99-5e56-4773-b47f-00b3b7b624ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1275 microversion: 2.1 time: 0.264317 Feb 28 19:02:52.786978 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 83/168] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:52 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:52.839493 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7dd45473-7a9a-48a2-ae1a-2897c23bd209 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:52.846629 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7dd45473-7a9a-48a2-ae1a-2897c23bd209 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.670249 Feb 28 19:02:52.855377 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 86/169] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:52 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:53.803856 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-80c66941-d0b0-41a1-b833-82ea7b52f5a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:53.804514 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-80c66941-d0b0-41a1-b833-82ea7b52f5a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:53.811859 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-80c66941-d0b0-41a1-b833-82ea7b52f5a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:53.812249 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-80c66941-d0b0-41a1-b833-82ea7b52f5a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:53.813026 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-80c66941-d0b0-41a1-b833-82ea7b52f5a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:53.813461 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-80c66941-d0b0-41a1-b833-82ea7b52f5a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:53.864627 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-79379e87-bd15-4cd7-8eff-da243da68f47 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:53.865241 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-79379e87-bd15-4cd7-8eff-da243da68f47 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:53.872947 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-79379e87-bd15-4cd7-8eff-da243da68f47 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:53.873393 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-79379e87-bd15-4cd7-8eff-da243da68f47 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:53.874166 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-79379e87-bd15-4cd7-8eff-da243da68f47 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:53.874924 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-79379e87-bd15-4cd7-8eff-da243da68f47 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:54.429577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-80c66941-d0b0-41a1-b833-82ea7b52f5a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:54.443874 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-80c66941-d0b0-41a1-b833-82ea7b52f5a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.643558 Feb 28 19:02:54.445856 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 84/170] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:53 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:54.465430 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-79379e87-bd15-4cd7-8eff-da243da68f47 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:54.472057 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-79379e87-bd15-4cd7-8eff-da243da68f47 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.611079 Feb 28 19:02:54.482485 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 87/171] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:53 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:54.863758 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-5f3195f9-34a0-4b93-8da0-807379515bce req-6b9ffb4f-8f84-4cd3-80a2-8ad278db4f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83758134-d6d4-4bf6-bdb6-f00ef16501ff", "tag": "f3587eff-27f1-497f-89ad-a020d585a895"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:02:54.865314 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:02:54.865314 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:02:54.881484 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-5f3195f9-34a0-4b93-8da0-807379515bce req-6b9ffb4f-8f84-4cd3-80a2-8ad278db4f52 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:54.882034 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-5f3195f9-34a0-4b93-8da0-807379515bce req-6b9ffb4f-8f84-4cd3-80a2-8ad278db4f52 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:54.903852 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-5f3195f9-34a0-4b93-8da0-807379515bce req-6b9ffb4f-8f84-4cd3-80a2-8ad278db4f52 service nova] Creating event network-changed:f3587eff-27f1-497f-89ad-a020d585a895 for instance 83758134-d6d4-4bf6-bdb6-f00ef16501ff on hv-cinder-83118 Feb 28 19:02:54.912859 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-5f3195f9-34a0-4b93-8da0-807379515bce req-6b9ffb4f-8f84-4cd3-80a2-8ad278db4f52 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052574 Feb 28 19:02:54.913475 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 85/172] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:02:55.462358 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-35824902-e73c-404d-8a43-5858651726f1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:55.464678 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-35824902-e73c-404d-8a43-5858651726f1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:55.478112 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-35824902-e73c-404d-8a43-5858651726f1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:55.479939 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-35824902-e73c-404d-8a43-5858651726f1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:55.480899 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-35824902-e73c-404d-8a43-5858651726f1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:55.481447 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-35824902-e73c-404d-8a43-5858651726f1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:55.490012 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9c53525d-d1ec-48fb-be15-ac43e15a7a1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:55.490905 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9c53525d-d1ec-48fb-be15-ac43e15a7a1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:55.509131 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9c53525d-d1ec-48fb-be15-ac43e15a7a1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:55.509956 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9c53525d-d1ec-48fb-be15-ac43e15a7a1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:55.511166 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9c53525d-d1ec-48fb-be15-ac43e15a7a1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:55.511758 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9c53525d-d1ec-48fb-be15-ac43e15a7a1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:55.879279 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-35824902-e73c-404d-8a43-5858651726f1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:55.892846 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-35824902-e73c-404d-8a43-5858651726f1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.431784 Feb 28 19:02:55.892985 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9c53525d-d1ec-48fb-be15-ac43e15a7a1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:55.893418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 88/173] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:55 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:55.900137 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9c53525d-d1ec-48fb-be15-ac43e15a7a1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.414166 Feb 28 19:02:55.900729 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 86/174] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:55 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:56.906067 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-dbe5912b-189a-48c9-8ba2-652bef0eb69c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:56.906689 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-dbe5912b-189a-48c9-8ba2-652bef0eb69c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:56.916602 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbe5912b-189a-48c9-8ba2-652bef0eb69c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:56.917898 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbe5912b-189a-48c9-8ba2-652bef0eb69c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:56.918032 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e782516d-1447-4898-8206-34a73d429387 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:56.918716 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e782516d-1447-4898-8206-34a73d429387 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:56.920370 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbe5912b-189a-48c9-8ba2-652bef0eb69c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:56.921378 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbe5912b-189a-48c9-8ba2-652bef0eb69c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:56.929151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e782516d-1447-4898-8206-34a73d429387 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:56.929816 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e782516d-1447-4898-8206-34a73d429387 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:56.930930 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e782516d-1447-4898-8206-34a73d429387 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:56.932290 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e782516d-1447-4898-8206-34a73d429387 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:57.233370 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dbe5912b-189a-48c9-8ba2-652bef0eb69c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:57.237592 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e782516d-1447-4898-8206-34a73d429387 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:57.242917 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-dbe5912b-189a-48c9-8ba2-652bef0eb69c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.340427 Feb 28 19:02:57.244135 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 89/175] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:56 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:57.246465 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e782516d-1447-4898-8206-34a73d429387 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.333709 Feb 28 19:02:57.250651 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 87/176] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:56 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:58.260315 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7bea30e0-33dc-43af-877f-bd3707d7248d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:58.260906 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7bea30e0-33dc-43af-877f-bd3707d7248d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:58.262626 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-216afe1b-67cc-4ced-a145-6b0b12248944 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:58.263272 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-216afe1b-67cc-4ced-a145-6b0b12248944 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:58.268551 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7bea30e0-33dc-43af-877f-bd3707d7248d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:58.269001 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7bea30e0-33dc-43af-877f-bd3707d7248d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:58.269764 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7bea30e0-33dc-43af-877f-bd3707d7248d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:58.270190 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7bea30e0-33dc-43af-877f-bd3707d7248d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:58.270284 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-216afe1b-67cc-4ced-a145-6b0b12248944 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:58.270721 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-216afe1b-67cc-4ced-a145-6b0b12248944 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:58.271537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-216afe1b-67cc-4ced-a145-6b0b12248944 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:58.271973 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-216afe1b-67cc-4ced-a145-6b0b12248944 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:58.562902 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7bea30e0-33dc-43af-877f-bd3707d7248d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:58.567137 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-216afe1b-67cc-4ced-a145-6b0b12248944 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:02:58.571843 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7bea30e0-33dc-43af-877f-bd3707d7248d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.315495 Feb 28 19:02:58.572635 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 90/177] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:58 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:02:58.576376 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-216afe1b-67cc-4ced-a145-6b0b12248944 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.317339 Feb 28 19:02:58.577189 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 88/178] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:58 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:02:59.587914 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-5eef32e1-5eb9-4d79-989a-83d230bda310 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:59.589325 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5eef32e1-5eb9-4d79-989a-83d230bda310 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:59.592828 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5587c408-ef67-42d5-8cce-e54079dbd62b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:02:59.593442 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5587c408-ef67-42d5-8cce-e54079dbd62b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:02:59.600600 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5eef32e1-5eb9-4d79-989a-83d230bda310 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:59.601051 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5eef32e1-5eb9-4d79-989a-83d230bda310 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:59.601347 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5587c408-ef67-42d5-8cce-e54079dbd62b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:59.601836 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5eef32e1-5eb9-4d79-989a-83d230bda310 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:59.602100 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5587c408-ef67-42d5-8cce-e54079dbd62b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:59.602268 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5eef32e1-5eb9-4d79-989a-83d230bda310 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:02:59.604500 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5587c408-ef67-42d5-8cce-e54079dbd62b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:02:59.605167 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5587c408-ef67-42d5-8cce-e54079dbd62b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:00.067007 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5587c408-ef67-42d5-8cce-e54079dbd62b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:00.076245 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5587c408-ef67-42d5-8cce-e54079dbd62b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.487130 Feb 28 19:03:00.076821 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 89/179] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:59 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:00.093318 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-5eef32e1-5eb9-4d79-989a-83d230bda310 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:00.102493 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-5eef32e1-5eb9-4d79-989a-83d230bda310 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.518209 Feb 28 19:03:00.103286 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 91/180] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:02:59 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:01.093586 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8e2b5136-6554-4098-98bb-136db54652e8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:01.094190 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8e2b5136-6554-4098-98bb-136db54652e8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:01.101592 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8e2b5136-6554-4098-98bb-136db54652e8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:01.102031 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8e2b5136-6554-4098-98bb-136db54652e8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:01.102790 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8e2b5136-6554-4098-98bb-136db54652e8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:01.103315 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8e2b5136-6554-4098-98bb-136db54652e8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:01.121788 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f348ec7c-8f22-4c86-a256-f968f6646949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:01.122409 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f348ec7c-8f22-4c86-a256-f968f6646949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:01.129750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f348ec7c-8f22-4c86-a256-f968f6646949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:01.130391 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f348ec7c-8f22-4c86-a256-f968f6646949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:01.131213 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f348ec7c-8f22-4c86-a256-f968f6646949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:01.131646 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f348ec7c-8f22-4c86-a256-f968f6646949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:01.480248 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8e2b5136-6554-4098-98bb-136db54652e8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:01.483214 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f348ec7c-8f22-4c86-a256-f968f6646949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:01.489043 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8e2b5136-6554-4098-98bb-136db54652e8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.399207 Feb 28 19:03:01.489710 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 90/181] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:01 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:01.491562 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f348ec7c-8f22-4c86-a256-f968f6646949 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.373380 Feb 28 19:03:01.492384 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 92/182] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:01 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:02.508094 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5e1dffad-33a2-4a85-a81e-7e3ab93368ec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:02.513662 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f30bfce6-f2d4-418e-aff5-78835f160701 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:02.513662 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f30bfce6-f2d4-418e-aff5-78835f160701 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:02.515491 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5e1dffad-33a2-4a85-a81e-7e3ab93368ec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:02.520486 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f30bfce6-f2d4-418e-aff5-78835f160701 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:02.520941 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f30bfce6-f2d4-418e-aff5-78835f160701 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:02.521769 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f30bfce6-f2d4-418e-aff5-78835f160701 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:02.522376 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f30bfce6-f2d4-418e-aff5-78835f160701 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:02.526883 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5e1dffad-33a2-4a85-a81e-7e3ab93368ec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:02.527397 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5e1dffad-33a2-4a85-a81e-7e3ab93368ec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:02.528995 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5e1dffad-33a2-4a85-a81e-7e3ab93368ec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:02.529588 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5e1dffad-33a2-4a85-a81e-7e3ab93368ec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:02.817730 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5e1dffad-33a2-4a85-a81e-7e3ab93368ec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:02.822768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f30bfce6-f2d4-418e-aff5-78835f160701 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:02.827707 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5e1dffad-33a2-4a85-a81e-7e3ab93368ec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.324575 Feb 28 19:03:02.828358 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 91/183] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:02 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:02.831756 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f30bfce6-f2d4-418e-aff5-78835f160701 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.326808 Feb 28 19:03:02.832476 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 93/184] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:02 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:03.845193 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-77f02082-d4a3-42ab-a084-7505bc34ae7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:03.845796 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-77f02082-d4a3-42ab-a084-7505bc34ae7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:03.848413 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ec9c65fb-dff2-428f-a9e3-23aa4f243e83 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:03.849025 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ec9c65fb-dff2-428f-a9e3-23aa4f243e83 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:03.856803 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-77f02082-d4a3-42ab-a084-7505bc34ae7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:03.856803 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-77f02082-d4a3-42ab-a084-7505bc34ae7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:03.856803 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-77f02082-d4a3-42ab-a084-7505bc34ae7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:03.856803 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-77f02082-d4a3-42ab-a084-7505bc34ae7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:03.857354 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ec9c65fb-dff2-428f-a9e3-23aa4f243e83 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:03.857594 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ec9c65fb-dff2-428f-a9e3-23aa4f243e83 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:03.858345 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ec9c65fb-dff2-428f-a9e3-23aa4f243e83 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:03.859241 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ec9c65fb-dff2-428f-a9e3-23aa4f243e83 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:04.156212 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-77f02082-d4a3-42ab-a084-7505bc34ae7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:04.164978 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-77f02082-d4a3-42ab-a084-7505bc34ae7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.323864 Feb 28 19:03:04.165824 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 92/185] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:03 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:04.176506 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ec9c65fb-dff2-428f-a9e3-23aa4f243e83 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:04.185035 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ec9c65fb-dff2-428f-a9e3-23aa4f243e83 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.340318 Feb 28 19:03:04.186318 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 94/186] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:03 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:05.182878 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5902c17a-fb9a-4a9a-af11-f551976bcfca tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:05.183525 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5902c17a-fb9a-4a9a-af11-f551976bcfca tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:05.190591 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5902c17a-fb9a-4a9a-af11-f551976bcfca tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:05.191038 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5902c17a-fb9a-4a9a-af11-f551976bcfca tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:05.191828 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5902c17a-fb9a-4a9a-af11-f551976bcfca tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:05.192261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5902c17a-fb9a-4a9a-af11-f551976bcfca tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:05.201485 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-aad3fe87-81fa-48cf-81b6-b8159c2d4658 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:05.202088 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-aad3fe87-81fa-48cf-81b6-b8159c2d4658 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:05.209340 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aad3fe87-81fa-48cf-81b6-b8159c2d4658 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:05.209722 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aad3fe87-81fa-48cf-81b6-b8159c2d4658 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:05.210647 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aad3fe87-81fa-48cf-81b6-b8159c2d4658 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:05.211077 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aad3fe87-81fa-48cf-81b6-b8159c2d4658 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:05.492425 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-aad3fe87-81fa-48cf-81b6-b8159c2d4658 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:05.497149 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5902c17a-fb9a-4a9a-af11-f551976bcfca tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:05.502689 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-aad3fe87-81fa-48cf-81b6-b8159c2d4658 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.304757 Feb 28 19:03:05.505421 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5902c17a-fb9a-4a9a-af11-f551976bcfca tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.326396 Feb 28 19:03:05.505992 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 93/187] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:05 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:05.509054 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 95/188] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:05 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:06.519890 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cfef47f8-8dab-4afd-8057-3c5dfaff8ad8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:06.520593 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-cfef47f8-8dab-4afd-8057-3c5dfaff8ad8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:06.522092 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2ff4bbca-3d5f-4c98-938c-3526d9aac4d6 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:06.522683 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2ff4bbca-3d5f-4c98-938c-3526d9aac4d6 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:06.529025 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cfef47f8-8dab-4afd-8057-3c5dfaff8ad8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:06.529780 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cfef47f8-8dab-4afd-8057-3c5dfaff8ad8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:06.530241 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cfef47f8-8dab-4afd-8057-3c5dfaff8ad8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:06.530734 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cfef47f8-8dab-4afd-8057-3c5dfaff8ad8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:06.534601 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2ff4bbca-3d5f-4c98-938c-3526d9aac4d6 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:06.535244 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2ff4bbca-3d5f-4c98-938c-3526d9aac4d6 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:06.536111 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2ff4bbca-3d5f-4c98-938c-3526d9aac4d6 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:06.536655 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2ff4bbca-3d5f-4c98-938c-3526d9aac4d6 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:06.838984 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-cfef47f8-8dab-4afd-8057-3c5dfaff8ad8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:06.846880 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2ff4bbca-3d5f-4c98-938c-3526d9aac4d6 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:06.847355 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-cfef47f8-8dab-4afd-8057-3c5dfaff8ad8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.331257 Feb 28 19:03:06.847923 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 94/189] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:06 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:06.856478 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2ff4bbca-3d5f-4c98-938c-3526d9aac4d6 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.337980 Feb 28 19:03:06.857228 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 96/190] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:06 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:07.865466 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-3a64ba7a-a99d-4d5e-9ceb-042c05179c2d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:07.866080 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-3a64ba7a-a99d-4d5e-9ceb-042c05179c2d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:07.873238 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9da4319a-2f02-4f2e-bac1-b5784ca5d7d4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:07.873779 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9da4319a-2f02-4f2e-bac1-b5784ca5d7d4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:07.873880 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3a64ba7a-a99d-4d5e-9ceb-042c05179c2d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:07.874371 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3a64ba7a-a99d-4d5e-9ceb-042c05179c2d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:07.875160 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3a64ba7a-a99d-4d5e-9ceb-042c05179c2d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:07.875596 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3a64ba7a-a99d-4d5e-9ceb-042c05179c2d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:07.881722 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9da4319a-2f02-4f2e-bac1-b5784ca5d7d4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:07.882165 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9da4319a-2f02-4f2e-bac1-b5784ca5d7d4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:07.882934 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9da4319a-2f02-4f2e-bac1-b5784ca5d7d4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:07.883396 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9da4319a-2f02-4f2e-bac1-b5784ca5d7d4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:08.187432 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-3a64ba7a-a99d-4d5e-9ceb-042c05179c2d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:08.195815 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9da4319a-2f02-4f2e-bac1-b5784ca5d7d4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:08.199942 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-3a64ba7a-a99d-4d5e-9ceb-042c05179c2d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.338081 Feb 28 19:03:08.200524 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 95/191] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:07 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:08.207983 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9da4319a-2f02-4f2e-bac1-b5784ca5d7d4 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.338387 Feb 28 19:03:08.209072 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 97/192] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:07 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:09.216880 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f57e6ec5-9423-4ddc-9cd6-4a3a1894d6d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:09.217549 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f57e6ec5-9423-4ddc-9cd6-4a3a1894d6d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:09.225407 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9bd8b816-5b50-4fe2-9a98-6558c147ad16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:09.226018 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9bd8b816-5b50-4fe2-9a98-6558c147ad16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:09.231304 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f57e6ec5-9423-4ddc-9cd6-4a3a1894d6d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:09.231304 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f57e6ec5-9423-4ddc-9cd6-4a3a1894d6d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:09.231304 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f57e6ec5-9423-4ddc-9cd6-4a3a1894d6d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:09.231304 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f57e6ec5-9423-4ddc-9cd6-4a3a1894d6d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:09.233302 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9bd8b816-5b50-4fe2-9a98-6558c147ad16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:09.233751 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9bd8b816-5b50-4fe2-9a98-6558c147ad16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:09.234520 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9bd8b816-5b50-4fe2-9a98-6558c147ad16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:09.234949 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9bd8b816-5b50-4fe2-9a98-6558c147ad16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:09.521853 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f57e6ec5-9423-4ddc-9cd6-4a3a1894d6d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:09.533141 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9bd8b816-5b50-4fe2-9a98-6558c147ad16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:09.534858 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f57e6ec5-9423-4ddc-9cd6-4a3a1894d6d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.322460 Feb 28 19:03:09.535609 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 96/193] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:09 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:09.544576 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9bd8b816-5b50-4fe2-9a98-6558c147ad16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.322702 Feb 28 19:03:09.545143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 98/194] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:09 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:10.552109 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-bc142cf6-4c25-41b3-8dca-e4806b320478 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:10.552771 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-bc142cf6-4c25-41b3-8dca-e4806b320478 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:10.560863 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bc142cf6-4c25-41b3-8dca-e4806b320478 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:10.561304 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bc142cf6-4c25-41b3-8dca-e4806b320478 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:10.561596 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ccb6a264-4c56-4126-9a57-0a7f08bb9889 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:10.562066 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bc142cf6-4c25-41b3-8dca-e4806b320478 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:10.562196 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ccb6a264-4c56-4126-9a57-0a7f08bb9889 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:10.562488 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bc142cf6-4c25-41b3-8dca-e4806b320478 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:10.569272 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ccb6a264-4c56-4126-9a57-0a7f08bb9889 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:10.569725 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ccb6a264-4c56-4126-9a57-0a7f08bb9889 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:10.570494 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ccb6a264-4c56-4126-9a57-0a7f08bb9889 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:10.570934 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ccb6a264-4c56-4126-9a57-0a7f08bb9889 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:10.948658 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bc142cf6-4c25-41b3-8dca-e4806b320478 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:10.953239 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ccb6a264-4c56-4126-9a57-0a7f08bb9889 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:10.957338 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-bc142cf6-4c25-41b3-8dca-e4806b320478 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.408916 Feb 28 19:03:10.958240 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 97/195] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:10 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:10.966903 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ccb6a264-4c56-4126-9a57-0a7f08bb9889 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.404248 Feb 28 19:03:10.966903 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 99/196] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:10 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:11.975678 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e458add6-fbed-4b6e-aef8-af705dd51569 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:11.976764 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e458add6-fbed-4b6e-aef8-af705dd51569 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:11.981756 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6fdd9b41-e6e4-49d0-a7dc-9a9bd4db4682 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:11.982369 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-6fdd9b41-e6e4-49d0-a7dc-9a9bd4db4682 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:11.994038 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6fdd9b41-e6e4-49d0-a7dc-9a9bd4db4682 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:11.994437 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6fdd9b41-e6e4-49d0-a7dc-9a9bd4db4682 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:11.994812 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e458add6-fbed-4b6e-aef8-af705dd51569 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:11.995244 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6fdd9b41-e6e4-49d0-a7dc-9a9bd4db4682 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:11.995572 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e458add6-fbed-4b6e-aef8-af705dd51569 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:11.995665 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6fdd9b41-e6e4-49d0-a7dc-9a9bd4db4682 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:11.996418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e458add6-fbed-4b6e-aef8-af705dd51569 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:11.996858 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e458add6-fbed-4b6e-aef8-af705dd51569 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:12.279605 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6fdd9b41-e6e4-49d0-a7dc-9a9bd4db4682 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:12.288214 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6fdd9b41-e6e4-49d0-a7dc-9a9bd4db4682 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.310567 Feb 28 19:03:12.288837 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 98/197] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:11 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:12.302106 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e458add6-fbed-4b6e-aef8-af705dd51569 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:12.311024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e458add6-fbed-4b6e-aef8-af705dd51569 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.340520 Feb 28 19:03:12.311661 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 100/198] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:11 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:12.501266 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-3e564be1-8d44-4449-915d-5fcca7f7c035 req-709f29cf-652e-41d4-9b42-9381a02372e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83758134-d6d4-4bf6-bdb6-f00ef16501ff", "name": "network-vif-plugged", "status": "completed", "tag": "f3587eff-27f1-497f-89ad-a020d585a895"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:03:12.502920 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:03:12.502920 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:03:12.512458 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-3e564be1-8d44-4449-915d-5fcca7f7c035 req-709f29cf-652e-41d4-9b42-9381a02372e4 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:12.513065 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-3e564be1-8d44-4449-915d-5fcca7f7c035 req-709f29cf-652e-41d4-9b42-9381a02372e4 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:12.529136 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-3e564be1-8d44-4449-915d-5fcca7f7c035 req-709f29cf-652e-41d4-9b42-9381a02372e4 service nova] Creating event network-vif-plugged:f3587eff-27f1-497f-89ad-a020d585a895 for instance 83758134-d6d4-4bf6-bdb6-f00ef16501ff on hv-cinder-83118 Feb 28 19:03:12.534671 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-3e564be1-8d44-4449-915d-5fcca7f7c035 req-709f29cf-652e-41d4-9b42-9381a02372e4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036980 Feb 28 19:03:12.535285 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 99/199] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:03:13.306937 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4d49b0d1-9c16-47b9-9b8e-f7e71a3f7652 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:13.307753 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4d49b0d1-9c16-47b9-9b8e-f7e71a3f7652 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:13.315710 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4d49b0d1-9c16-47b9-9b8e-f7e71a3f7652 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:13.316160 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4d49b0d1-9c16-47b9-9b8e-f7e71a3f7652 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:13.316922 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4d49b0d1-9c16-47b9-9b8e-f7e71a3f7652 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:13.317340 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4d49b0d1-9c16-47b9-9b8e-f7e71a3f7652 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:13.328547 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4d87155b-fe1e-43d4-b98a-6a8c739dbf03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:13.329236 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4d87155b-fe1e-43d4-b98a-6a8c739dbf03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:13.338753 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4d87155b-fe1e-43d4-b98a-6a8c739dbf03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:13.339371 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4d87155b-fe1e-43d4-b98a-6a8c739dbf03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:13.340276 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4d87155b-fe1e-43d4-b98a-6a8c739dbf03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:13.340872 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4d87155b-fe1e-43d4-b98a-6a8c739dbf03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:13.719591 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4d49b0d1-9c16-47b9-9b8e-f7e71a3f7652 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:13.747056 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4d49b0d1-9c16-47b9-9b8e-f7e71a3f7652 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.444680 Feb 28 19:03:13.748031 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 101/200] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:13 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:13.748526 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4d87155b-fe1e-43d4-b98a-6a8c739dbf03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:13.765181 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4d87155b-fe1e-43d4-b98a-6a8c739dbf03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.441037 Feb 28 19:03:13.765755 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 100/201] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:13 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:14.771349 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-352c7c0f-0a4e-450e-84dc-04611d1117f8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:14.771349 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-352c7c0f-0a4e-450e-84dc-04611d1117f8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:14.772521 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-352c7c0f-0a4e-450e-84dc-04611d1117f8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:14.772974 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-352c7c0f-0a4e-450e-84dc-04611d1117f8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:14.773750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-352c7c0f-0a4e-450e-84dc-04611d1117f8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:14.774179 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-352c7c0f-0a4e-450e-84dc-04611d1117f8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:14.783319 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-944e625e-ece4-4ade-a030-da415e18e999 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:14.784097 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-944e625e-ece4-4ade-a030-da415e18e999 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:14.793493 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-944e625e-ece4-4ade-a030-da415e18e999 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:14.794147 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-944e625e-ece4-4ade-a030-da415e18e999 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:14.795558 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-944e625e-ece4-4ade-a030-da415e18e999 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:14.795958 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-944e625e-ece4-4ade-a030-da415e18e999 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:15.085091 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-352c7c0f-0a4e-450e-84dc-04611d1117f8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:15.089030 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-944e625e-ece4-4ade-a030-da415e18e999 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:15.093768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-352c7c0f-0a4e-450e-84dc-04611d1117f8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.333770 Feb 28 19:03:15.094384 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 102/202] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:14 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:15.096337 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-944e625e-ece4-4ade-a030-da415e18e999 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1317 microversion: 2.1 time: 0.317355 Feb 28 19:03:15.096892 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 101/203] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:14 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:16.112500 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e94c8881-8dba-4e00-95ff-abab4c40a293 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:16.113108 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e94c8881-8dba-4e00-95ff-abab4c40a293 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:16.114887 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-dbe7ec2b-4c98-4094-a10e-2fb5226121b5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:16.115623 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-dbe7ec2b-4c98-4094-a10e-2fb5226121b5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:16.121673 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e94c8881-8dba-4e00-95ff-abab4c40a293 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:16.122224 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e94c8881-8dba-4e00-95ff-abab4c40a293 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:16.123005 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e94c8881-8dba-4e00-95ff-abab4c40a293 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:16.123602 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e94c8881-8dba-4e00-95ff-abab4c40a293 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:16.126391 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dbe7ec2b-4c98-4094-a10e-2fb5226121b5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:16.127061 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dbe7ec2b-4c98-4094-a10e-2fb5226121b5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:16.128004 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dbe7ec2b-4c98-4094-a10e-2fb5226121b5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:16.128499 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dbe7ec2b-4c98-4094-a10e-2fb5226121b5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:16.427760 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e94c8881-8dba-4e00-95ff-abab4c40a293 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:16.440056 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e94c8881-8dba-4e00-95ff-abab4c40a293 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.331556 Feb 28 19:03:16.441060 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-dbe7ec2b-4c98-4094-a10e-2fb5226121b5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:16.442096 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 103/204] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:16 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:16.451618 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-dbe7ec2b-4c98-4094-a10e-2fb5226121b5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1506 microversion: 2.1 time: 0.342182 Feb 28 19:03:16.456251 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 102/205] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:16 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:16.472866 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-164c1be2-5240-4592-85ca-841aac43449f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49b66d02-5e71-4194-a79b-e408ba96482f"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:03:16.474258 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-164c1be2-5240-4592-85ca-841aac43449f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:16.486198 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-164c1be2-5240-4592-85ca-841aac43449f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:16.486647 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-164c1be2-5240-4592-85ca-841aac43449f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:16.487527 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-164c1be2-5240-4592-85ca-841aac43449f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:16.487894 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-164c1be2-5240-4592-85ca-841aac43449f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:16.637165 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-164c1be2-5240-4592-85ca-841aac43449f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] HTTP exception thrown: Invalid volume: volume 49b66d02-5e71-4194-a79b-e408ba96482f is already attached to instances: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 Feb 28 19:03:16.637765 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-164c1be2-5240-4592-85ca-841aac43449f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Returning 400 to user: Invalid volume: volume 49b66d02-5e71-4194-a79b-e408ba96482f is already attached to instances: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:03:16.638583 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-164c1be2-5240-4592-85ca-841aac43449f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "POST /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.169732 Feb 28 19:03:16.639143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 104/206] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:03:16 2022] POST /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff/os-volume_attachments => generated 174 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 28 19:03:16.735019 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-23ee8979-7db3-44b6-8a9b-d9942f0c0c53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:16.735540 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-23ee8979-7db3-44b6-8a9b-d9942f0c0c53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:16.742692 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-23ee8979-7db3-44b6-8a9b-d9942f0c0c53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:16.743361 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-23ee8979-7db3-44b6-8a9b-d9942f0c0c53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:16.744211 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-23ee8979-7db3-44b6-8a9b-d9942f0c0c53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:16.744644 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-23ee8979-7db3-44b6-8a9b-d9942f0c0c53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:16.945640 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-23ee8979-7db3-44b6-8a9b-d9942f0c0c53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lazy-loading 'services' on Instance uuid 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:03:17.362194 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-23ee8979-7db3-44b6-8a9b-d9942f0c0c53 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "DELETE /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6/os-volume_attachments/49b66d02-5e71-4194-a79b-e408ba96482f" status: 202 len: 0 microversion: 2.1 time: 0.630688 Feb 28 19:03:17.365882 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 103/207] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:03:16 2022] DELETE /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6/os-volume_attachments/49b66d02-5e71-4194-a79b-e408ba96482f => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:03:17.378120 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-bdd55126-d24d-4ae4-a844-0d852d33d0ed tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:17.380281 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-bdd55126-d24d-4ae4-a844-0d852d33d0ed tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:17.403605 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bdd55126-d24d-4ae4-a844-0d852d33d0ed tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:17.405340 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bdd55126-d24d-4ae4-a844-0d852d33d0ed tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:17.409249 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bdd55126-d24d-4ae4-a844-0d852d33d0ed tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:17.409785 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bdd55126-d24d-4ae4-a844-0d852d33d0ed tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:17.458793 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8ec6ae4d-8e48-4701-90e5-b3f8afc3215f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:17.459676 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8ec6ae4d-8e48-4701-90e5-b3f8afc3215f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:17.468258 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ec6ae4d-8e48-4701-90e5-b3f8afc3215f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:17.468963 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ec6ae4d-8e48-4701-90e5-b3f8afc3215f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:17.469999 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ec6ae4d-8e48-4701-90e5-b3f8afc3215f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:17.470906 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ec6ae4d-8e48-4701-90e5-b3f8afc3215f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:17.515350 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-bdd55126-d24d-4ae4-a844-0d852d33d0ed tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147975 Feb 28 19:03:17.516367 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 105/208] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:03:17 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:03:17.706499 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8ec6ae4d-8e48-4701-90e5-b3f8afc3215f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:17.718498 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8ec6ae4d-8e48-4701-90e5-b3f8afc3215f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1521 microversion: 2.1 time: 0.264081 Feb 28 19:03:17.719761 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 104/209] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:17 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:18.528619 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b437a15a-d92a-4118-adbd-ad280c2cddfa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:18.529526 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b437a15a-d92a-4118-adbd-ad280c2cddfa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:18.536871 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b437a15a-d92a-4118-adbd-ad280c2cddfa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:18.537311 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b437a15a-d92a-4118-adbd-ad280c2cddfa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:18.538074 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b437a15a-d92a-4118-adbd-ad280c2cddfa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:18.538499 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b437a15a-d92a-4118-adbd-ad280c2cddfa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:18.610510 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b437a15a-d92a-4118-adbd-ad280c2cddfa tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086095 Feb 28 19:03:18.611066 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 106/210] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:03:18 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:03:18.736551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d055a83d-6b53-49f3-a100-577c7c7907b8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:18.737875 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d055a83d-6b53-49f3-a100-577c7c7907b8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:18.745581 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d055a83d-6b53-49f3-a100-577c7c7907b8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:18.746084 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d055a83d-6b53-49f3-a100-577c7c7907b8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:18.752068 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d055a83d-6b53-49f3-a100-577c7c7907b8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:18.752068 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d055a83d-6b53-49f3-a100-577c7c7907b8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:18.972726 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d055a83d-6b53-49f3-a100-577c7c7907b8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:18.981755 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d055a83d-6b53-49f3-a100-577c7c7907b8 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1501 microversion: 2.1 time: 0.249048 Feb 28 19:03:18.982393 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 105/211] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:18 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:18.997748 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-573c3b55-2682-4c6d-86a9-1e2f73b10dc9 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:18.998517 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-573c3b55-2682-4c6d-86a9-1e2f73b10dc9 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:19.005907 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-573c3b55-2682-4c6d-86a9-1e2f73b10dc9 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:19.006543 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-573c3b55-2682-4c6d-86a9-1e2f73b10dc9 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:19.007464 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-573c3b55-2682-4c6d-86a9-1e2f73b10dc9 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:19.010807 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-573c3b55-2682-4c6d-86a9-1e2f73b10dc9 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:19.221216 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-573c3b55-2682-4c6d-86a9-1e2f73b10dc9 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:19.229922 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-573c3b55-2682-4c6d-86a9-1e2f73b10dc9 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1513 microversion: 2.1 time: 0.235819 Feb 28 19:03:19.230492 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 107/212] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:18 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:19.622431 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d379c325-f7d9-4c65-9b86-ad5cddb88d4d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:19.623426 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d379c325-f7d9-4c65-9b86-ad5cddb88d4d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:19.630577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d379c325-f7d9-4c65-9b86-ad5cddb88d4d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:19.631163 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d379c325-f7d9-4c65-9b86-ad5cddb88d4d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:19.631908 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d379c325-f7d9-4c65-9b86-ad5cddb88d4d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:19.632394 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d379c325-f7d9-4c65-9b86-ad5cddb88d4d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:19.697541 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d379c325-f7d9-4c65-9b86-ad5cddb88d4d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079388 Feb 28 19:03:19.698098 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 106/213] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:03:19 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 19:03:20.290923 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-52315146", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "networks": [{"uuid": "449788a3-ff13-44f6-8b3b-66a4d81bb7d5"}]}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:03:20.361316 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] validate_networks() for [('449788a3-ff13-44f6-8b3b-66a4d81bb7d5', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:03:20.997467 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:03:20.997885 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:03:20.998355 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:03:20.998760 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:03:20.999191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:03:21.008212 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:21.008915 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:21.009710 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:21.010134 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:21.028522 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Getting quotas for project 498eaf5c78e54296ac5cdeef3489e3ef. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:03:21.032572 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Getting quotas for user 46e767d2e3624a3fa799c8c1b20b0516 and project 498eaf5c78e54296ac5cdeef3489e3ef. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:03:21.044118 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:03:21.046687 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:03:21.266945 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-28d69c63-3026-4874-8f3f-22292ea33075 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981021 Feb 28 19:03:21.267718 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 108/214] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:03:21.278055 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5091ee93-c735-448c-a9cd-ce3604171918 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:21.279408 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5091ee93-c735-448c-a9cd-ce3604171918 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:21.370911 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5091ee93-c735-448c-a9cd-ce3604171918 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:21.373952 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5091ee93-c735-448c-a9cd-ce3604171918 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1216 microversion: 2.1 time: 0.100290 Feb 28 19:03:21.383259 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 107/215] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:21 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1216 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:22.393663 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-83aab421-9333-4a09-b0d9-2c32d56f7938 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:22.395199 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-83aab421-9333-4a09-b0d9-2c32d56f7938 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:22.407563 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-83aab421-9333-4a09-b0d9-2c32d56f7938 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:22.408009 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-83aab421-9333-4a09-b0d9-2c32d56f7938 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:22.408854 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-83aab421-9333-4a09-b0d9-2c32d56f7938 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:22.409388 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-83aab421-9333-4a09-b0d9-2c32d56f7938 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:22.555312 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-83aab421-9333-4a09-b0d9-2c32d56f7938 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:22.565799 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-83aab421-9333-4a09-b0d9-2c32d56f7938 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1220 microversion: 2.1 time: 0.178861 Feb 28 19:03:22.567177 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 109/216] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:22 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:22.594694 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-bfe9fcc1-a720-4348-880d-3fa9a9f7233e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:03:22.595675 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-bfe9fcc1-a720-4348-880d-3fa9a9f7233e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:22.604955 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bfe9fcc1-a720-4348-880d-3fa9a9f7233e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:22.605413 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bfe9fcc1-a720-4348-880d-3fa9a9f7233e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:22.606391 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bfe9fcc1-a720-4348-880d-3fa9a9f7233e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:22.612994 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bfe9fcc1-a720-4348-880d-3fa9a9f7233e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:22.667644 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-bfe9fcc1-a720-4348-880d-3fa9a9f7233e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lazy-loading 'flavor' on Instance uuid 26980bce-633e-4e70-9ebd-c1a38fb5cc4a {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:03:23.420504 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-bfe9fcc1-a720-4348-880d-3fa9a9f7233e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/action" status: 200 len: 32 microversion: 2.1 time: 0.829192 Feb 28 19:03:23.421100 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 108/217] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:03:22 2022] POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/action => generated 32 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 19:03:23.429922 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-79e0b6cb-41ce-48be-a212-d024f832a6bb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:23.431733 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-79e0b6cb-41ce-48be-a212-d024f832a6bb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:23.444186 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-79e0b6cb-41ce-48be-a212-d024f832a6bb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:23.444707 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-79e0b6cb-41ce-48be-a212-d024f832a6bb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:23.445638 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-79e0b6cb-41ce-48be-a212-d024f832a6bb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:23.446847 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-79e0b6cb-41ce-48be-a212-d024f832a6bb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:23.585033 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b8cd649b-cc90-4dc1-96e1-62ed1b1417d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:23.585809 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b8cd649b-cc90-4dc1-96e1-62ed1b1417d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:23.594422 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b8cd649b-cc90-4dc1-96e1-62ed1b1417d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:23.595174 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b8cd649b-cc90-4dc1-96e1-62ed1b1417d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:23.596467 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b8cd649b-cc90-4dc1-96e1-62ed1b1417d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:23.596950 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b8cd649b-cc90-4dc1-96e1-62ed1b1417d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:23.752916 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b8cd649b-cc90-4dc1-96e1-62ed1b1417d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:23.762841 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b8cd649b-cc90-4dc1-96e1-62ed1b1417d6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1268 microversion: 2.1 time: 0.182369 Feb 28 19:03:23.772967 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 109/218] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:23 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1268 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:23.890566 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-79e0b6cb-41ce-48be-a212-d024f832a6bb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:23.906110 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-79e0b6cb-41ce-48be-a212-d024f832a6bb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.479695 Feb 28 19:03:23.915450 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 110/219] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:23 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:24.780354 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5467243b-6572-4684-aeb8-c35bd91aedd8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:24.781571 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5467243b-6572-4684-aeb8-c35bd91aedd8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:24.799816 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5467243b-6572-4684-aeb8-c35bd91aedd8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:24.800731 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5467243b-6572-4684-aeb8-c35bd91aedd8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:24.801678 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5467243b-6572-4684-aeb8-c35bd91aedd8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:24.802282 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5467243b-6572-4684-aeb8-c35bd91aedd8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:24.924679 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f80b2be0-953f-4e04-b710-cc8a2ab3a30a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:24.925986 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f80b2be0-953f-4e04-b710-cc8a2ab3a30a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:24.935033 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f80b2be0-953f-4e04-b710-cc8a2ab3a30a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:24.936009 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f80b2be0-953f-4e04-b710-cc8a2ab3a30a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:24.938557 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f80b2be0-953f-4e04-b710-cc8a2ab3a30a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:24.938557 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f80b2be0-953f-4e04-b710-cc8a2ab3a30a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:24.979511 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5467243b-6572-4684-aeb8-c35bd91aedd8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:24.989864 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5467243b-6572-4684-aeb8-c35bd91aedd8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1286 microversion: 2.1 time: 0.213231 Feb 28 19:03:25.002906 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 110/220] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:24 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:25.280761 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f80b2be0-953f-4e04-b710-cc8a2ab3a30a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:25.289446 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f80b2be0-953f-4e04-b710-cc8a2ab3a30a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.368772 Feb 28 19:03:25.290837 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 111/221] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:24 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:26.009555 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-75394701-ad4a-419e-bc2e-44a8267916d7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:26.010251 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-75394701-ad4a-419e-bc2e-44a8267916d7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:26.018067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-75394701-ad4a-419e-bc2e-44a8267916d7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:26.018617 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-75394701-ad4a-419e-bc2e-44a8267916d7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:26.019496 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-75394701-ad4a-419e-bc2e-44a8267916d7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:26.019999 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-75394701-ad4a-419e-bc2e-44a8267916d7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:26.308822 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-3cef4eda-e9b6-40ac-bf12-574e2f7d6ecc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:26.310047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3cef4eda-e9b6-40ac-bf12-574e2f7d6ecc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:26.324652 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3cef4eda-e9b6-40ac-bf12-574e2f7d6ecc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:26.325358 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3cef4eda-e9b6-40ac-bf12-574e2f7d6ecc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:26.326326 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3cef4eda-e9b6-40ac-bf12-574e2f7d6ecc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:26.327187 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3cef4eda-e9b6-40ac-bf12-574e2f7d6ecc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:26.356229 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-75394701-ad4a-419e-bc2e-44a8267916d7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:26.368860 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-75394701-ad4a-419e-bc2e-44a8267916d7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.362180 Feb 28 19:03:26.389543 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 111/222] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:26 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:26.559364 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-3cef4eda-e9b6-40ac-bf12-574e2f7d6ecc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:26.567742 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-3cef4eda-e9b6-40ac-bf12-574e2f7d6ecc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.263386 Feb 28 19:03:26.568311 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 112/223] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:26 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:27.177074 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-e388311d-ef45-4ddb-a70b-6d9ea8348b40 req-237e6704-b260-4ad3-8a3c-58198650df64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fea77b98-2b78-485a-beab-edf47a4fcc72", "tag": "4446a787-0e66-4e50-9cbc-2341e7399a85"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:03:27.180147 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:03:27.180147 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:03:27.189799 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-e388311d-ef45-4ddb-a70b-6d9ea8348b40 req-237e6704-b260-4ad3-8a3c-58198650df64 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:27.190565 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-e388311d-ef45-4ddb-a70b-6d9ea8348b40 req-237e6704-b260-4ad3-8a3c-58198650df64 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:27.209346 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-e388311d-ef45-4ddb-a70b-6d9ea8348b40 req-237e6704-b260-4ad3-8a3c-58198650df64 service nova] Creating event network-changed:4446a787-0e66-4e50-9cbc-2341e7399a85 for instance fea77b98-2b78-485a-beab-edf47a4fcc72 on hv-cinder-83118 Feb 28 19:03:27.215142 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-e388311d-ef45-4ddb-a70b-6d9ea8348b40 req-237e6704-b260-4ad3-8a3c-58198650df64 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046963 Feb 28 19:03:27.216202 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 112/224] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:03:27.390477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-5b902703-d4a8-4ba2-b349-8dce2561841c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:27.391219 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5b902703-d4a8-4ba2-b349-8dce2561841c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:27.410291 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5b902703-d4a8-4ba2-b349-8dce2561841c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:27.410848 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5b902703-d4a8-4ba2-b349-8dce2561841c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:27.411728 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5b902703-d4a8-4ba2-b349-8dce2561841c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:27.412979 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5b902703-d4a8-4ba2-b349-8dce2561841c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:27.588915 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ee899b7c-592f-4d0f-86b2-1dff1441ffe1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:27.589637 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ee899b7c-592f-4d0f-86b2-1dff1441ffe1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:27.608005 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ee899b7c-592f-4d0f-86b2-1dff1441ffe1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:27.608515 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ee899b7c-592f-4d0f-86b2-1dff1441ffe1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:27.609331 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ee899b7c-592f-4d0f-86b2-1dff1441ffe1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:27.609766 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ee899b7c-592f-4d0f-86b2-1dff1441ffe1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:27.675980 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-5b902703-d4a8-4ba2-b349-8dce2561841c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:27.691243 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-5b902703-d4a8-4ba2-b349-8dce2561841c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.308038 Feb 28 19:03:27.695643 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 113/225] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:27 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:27.845830 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ee899b7c-592f-4d0f-86b2-1dff1441ffe1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:27.854871 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ee899b7c-592f-4d0f-86b2-1dff1441ffe1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.273050 Feb 28 19:03:27.863950 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 113/226] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:27 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:28.726683 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-48de8594-17c2-47af-9df7-e69bd90d4ce6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:28.732031 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-48de8594-17c2-47af-9df7-e69bd90d4ce6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:28.740539 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48de8594-17c2-47af-9df7-e69bd90d4ce6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:28.741009 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48de8594-17c2-47af-9df7-e69bd90d4ce6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:28.741869 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48de8594-17c2-47af-9df7-e69bd90d4ce6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:28.742374 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48de8594-17c2-47af-9df7-e69bd90d4ce6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:28.872142 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-65cb95a9-a6ad-463a-a238-e29615a0d59f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:28.874973 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-65cb95a9-a6ad-463a-a238-e29615a0d59f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:28.880106 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-65cb95a9-a6ad-463a-a238-e29615a0d59f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:28.880543 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-65cb95a9-a6ad-463a-a238-e29615a0d59f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:28.881820 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-65cb95a9-a6ad-463a-a238-e29615a0d59f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:28.881820 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-65cb95a9-a6ad-463a-a238-e29615a0d59f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:28.952573 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-48de8594-17c2-47af-9df7-e69bd90d4ce6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:28.961871 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-48de8594-17c2-47af-9df7-e69bd90d4ce6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.240513 Feb 28 19:03:28.965093 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 114/227] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:28 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:29.103035 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-65cb95a9-a6ad-463a-a238-e29615a0d59f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:29.112741 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-65cb95a9-a6ad-463a-a238-e29615a0d59f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.245099 Feb 28 19:03:29.113321 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 114/228] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:28 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:29.980111 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fc2758d7-4b29-4247-9678-9509ee6021eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:29.980748 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-fc2758d7-4b29-4247-9678-9509ee6021eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:29.992611 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc2758d7-4b29-4247-9678-9509ee6021eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:29.993961 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc2758d7-4b29-4247-9678-9509ee6021eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:29.995611 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc2758d7-4b29-4247-9678-9509ee6021eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:29.996611 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc2758d7-4b29-4247-9678-9509ee6021eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:30.129824 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-27c845ff-aaae-481d-b579-db2ebb39066a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:30.130872 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-27c845ff-aaae-481d-b579-db2ebb39066a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:30.138438 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-27c845ff-aaae-481d-b579-db2ebb39066a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:30.138948 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-27c845ff-aaae-481d-b579-db2ebb39066a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:30.140234 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-27c845ff-aaae-481d-b579-db2ebb39066a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:30.140606 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-27c845ff-aaae-481d-b579-db2ebb39066a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:30.216161 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fc2758d7-4b29-4247-9678-9509ee6021eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:30.225674 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-fc2758d7-4b29-4247-9678-9509ee6021eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.250790 Feb 28 19:03:30.226351 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 115/229] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:29 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:30.345986 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-27c845ff-aaae-481d-b579-db2ebb39066a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:30.354922 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-27c845ff-aaae-481d-b579-db2ebb39066a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.228846 Feb 28 19:03:30.355554 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 115/230] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:30 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:31.246080 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-329c3520-34d2-42de-9cce-e4b67907c16a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:31.246080 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-329c3520-34d2-42de-9cce-e4b67907c16a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:31.251322 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-329c3520-34d2-42de-9cce-e4b67907c16a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:31.251773 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-329c3520-34d2-42de-9cce-e4b67907c16a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:31.252624 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-329c3520-34d2-42de-9cce-e4b67907c16a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:31.253064 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-329c3520-34d2-42de-9cce-e4b67907c16a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:31.372633 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1f239e38-5609-44a0-b624-45ca94e82204 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:31.373254 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1f239e38-5609-44a0-b624-45ca94e82204 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:31.381129 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1f239e38-5609-44a0-b624-45ca94e82204 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:31.381740 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1f239e38-5609-44a0-b624-45ca94e82204 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:31.382701 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1f239e38-5609-44a0-b624-45ca94e82204 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:31.383874 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1f239e38-5609-44a0-b624-45ca94e82204 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:31.456079 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-329c3520-34d2-42de-9cce-e4b67907c16a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:31.464441 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-329c3520-34d2-42de-9cce-e4b67907c16a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.225352 Feb 28 19:03:31.465012 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 116/231] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:31 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:31.589498 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1f239e38-5609-44a0-b624-45ca94e82204 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:31.598151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1f239e38-5609-44a0-b624-45ca94e82204 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.229132 Feb 28 19:03:31.598789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 116/232] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:31 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:32.480771 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8f29246f-0337-48e9-aeee-a4e3bb02d8d5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:32.481428 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8f29246f-0337-48e9-aeee-a4e3bb02d8d5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:32.488567 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8f29246f-0337-48e9-aeee-a4e3bb02d8d5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:32.489032 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8f29246f-0337-48e9-aeee-a4e3bb02d8d5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:32.490240 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8f29246f-0337-48e9-aeee-a4e3bb02d8d5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:32.490240 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8f29246f-0337-48e9-aeee-a4e3bb02d8d5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:32.615193 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8d01cf4b-7755-4cc9-b827-d4d16bcbe522 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:32.616023 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8d01cf4b-7755-4cc9-b827-d4d16bcbe522 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:32.624388 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8d01cf4b-7755-4cc9-b827-d4d16bcbe522 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:32.625113 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8d01cf4b-7755-4cc9-b827-d4d16bcbe522 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:32.626095 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8d01cf4b-7755-4cc9-b827-d4d16bcbe522 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:32.626768 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8d01cf4b-7755-4cc9-b827-d4d16bcbe522 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:32.690507 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8f29246f-0337-48e9-aeee-a4e3bb02d8d5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:32.700217 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8f29246f-0337-48e9-aeee-a4e3bb02d8d5 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.223375 Feb 28 19:03:32.700802 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 117/233] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:32 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:32.831092 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8d01cf4b-7755-4cc9-b827-d4d16bcbe522 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:32.840115 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8d01cf4b-7755-4cc9-b827-d4d16bcbe522 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.228904 Feb 28 19:03:32.840689 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 117/234] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:32 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:33.717001 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-40219e32-72e4-46cd-909f-ee4dc6847f7f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:33.717610 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-40219e32-72e4-46cd-909f-ee4dc6847f7f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:33.725071 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40219e32-72e4-46cd-909f-ee4dc6847f7f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:33.728478 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40219e32-72e4-46cd-909f-ee4dc6847f7f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:33.728478 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40219e32-72e4-46cd-909f-ee4dc6847f7f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:33.728478 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40219e32-72e4-46cd-909f-ee4dc6847f7f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:33.856661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1bc052d2-eb5f-4cad-ba5a-0092cc997da0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:33.858899 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1bc052d2-eb5f-4cad-ba5a-0092cc997da0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:33.866056 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1bc052d2-eb5f-4cad-ba5a-0092cc997da0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:33.866849 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1bc052d2-eb5f-4cad-ba5a-0092cc997da0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:33.867810 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1bc052d2-eb5f-4cad-ba5a-0092cc997da0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:33.868442 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1bc052d2-eb5f-4cad-ba5a-0092cc997da0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:33.931704 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-40219e32-72e4-46cd-909f-ee4dc6847f7f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:33.940490 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-40219e32-72e4-46cd-909f-ee4dc6847f7f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.227186 Feb 28 19:03:33.941287 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 118/235] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:33 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:34.075601 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1bc052d2-eb5f-4cad-ba5a-0092cc997da0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:34.084204 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1bc052d2-eb5f-4cad-ba5a-0092cc997da0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.231054 Feb 28 19:03:34.084903 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 118/236] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:33 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:34.957297 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-40d7fd8f-5a78-4c70-80f5-2e4491b14c0f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:34.957994 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-40d7fd8f-5a78-4c70-80f5-2e4491b14c0f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:34.965889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40d7fd8f-5a78-4c70-80f5-2e4491b14c0f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:34.966370 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40d7fd8f-5a78-4c70-80f5-2e4491b14c0f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:34.967164 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40d7fd8f-5a78-4c70-80f5-2e4491b14c0f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:34.967604 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40d7fd8f-5a78-4c70-80f5-2e4491b14c0f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:35.101370 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e3f84b38-06ba-4556-b32e-4cb79b56a618 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:35.102832 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e3f84b38-06ba-4556-b32e-4cb79b56a618 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:35.110567 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e3f84b38-06ba-4556-b32e-4cb79b56a618 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:35.111016 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e3f84b38-06ba-4556-b32e-4cb79b56a618 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:35.111860 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e3f84b38-06ba-4556-b32e-4cb79b56a618 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:35.112285 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e3f84b38-06ba-4556-b32e-4cb79b56a618 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:35.368894 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-40d7fd8f-5a78-4c70-80f5-2e4491b14c0f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:35.380726 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-40d7fd8f-5a78-4c70-80f5-2e4491b14c0f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.426708 Feb 28 19:03:35.382260 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 119/237] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:34 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:35.447147 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e3f84b38-06ba-4556-b32e-4cb79b56a618 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:35.455429 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e3f84b38-06ba-4556-b32e-4cb79b56a618 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.357790 Feb 28 19:03:35.455997 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 119/238] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:35 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:36.397829 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b35d5b3a-e029-455d-8210-19bb6d8cac5c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:36.398673 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b35d5b3a-e029-455d-8210-19bb6d8cac5c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:36.405825 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b35d5b3a-e029-455d-8210-19bb6d8cac5c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:36.406274 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b35d5b3a-e029-455d-8210-19bb6d8cac5c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:36.407072 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b35d5b3a-e029-455d-8210-19bb6d8cac5c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:36.407535 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b35d5b3a-e029-455d-8210-19bb6d8cac5c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:36.472151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1421127d-0dfd-4eff-bee9-0084cf18b940 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:36.477276 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1421127d-0dfd-4eff-bee9-0084cf18b940 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:36.485318 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1421127d-0dfd-4eff-bee9-0084cf18b940 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:36.485855 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1421127d-0dfd-4eff-bee9-0084cf18b940 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:36.486731 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1421127d-0dfd-4eff-bee9-0084cf18b940 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:36.487258 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1421127d-0dfd-4eff-bee9-0084cf18b940 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:36.659297 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b35d5b3a-e029-455d-8210-19bb6d8cac5c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:36.670502 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b35d5b3a-e029-455d-8210-19bb6d8cac5c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.275768 Feb 28 19:03:36.671488 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 120/239] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:36 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:36.742895 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1421127d-0dfd-4eff-bee9-0084cf18b940 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:36.751159 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1421127d-0dfd-4eff-bee9-0084cf18b940 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.282572 Feb 28 19:03:36.751740 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 120/240] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:36 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:37.688539 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-489bd314-b9bd-47cc-aced-c625d05ca9de tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:37.689387 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-489bd314-b9bd-47cc-aced-c625d05ca9de tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:37.697597 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-489bd314-b9bd-47cc-aced-c625d05ca9de tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:37.698045 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-489bd314-b9bd-47cc-aced-c625d05ca9de tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:37.698819 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-489bd314-b9bd-47cc-aced-c625d05ca9de tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:37.699289 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-489bd314-b9bd-47cc-aced-c625d05ca9de tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:37.768577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-518c9264-97a0-40cf-94be-63692b2225d0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:37.769808 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-518c9264-97a0-40cf-94be-63692b2225d0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:37.778000 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-518c9264-97a0-40cf-94be-63692b2225d0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:37.778672 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-518c9264-97a0-40cf-94be-63692b2225d0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:37.779636 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-518c9264-97a0-40cf-94be-63692b2225d0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:37.780251 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-518c9264-97a0-40cf-94be-63692b2225d0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:37.947915 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-489bd314-b9bd-47cc-aced-c625d05ca9de tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:37.969851 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-489bd314-b9bd-47cc-aced-c625d05ca9de tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.278837 Feb 28 19:03:37.970499 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 121/241] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:37 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:38.054345 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-518c9264-97a0-40cf-94be-63692b2225d0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:38.063058 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-518c9264-97a0-40cf-94be-63692b2225d0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.298109 Feb 28 19:03:38.063864 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 121/242] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:37 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:38.988874 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-81969c9f-cd4c-4da5-9c6c-1143abc4be7c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:38.990468 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-81969c9f-cd4c-4da5-9c6c-1143abc4be7c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:38.998496 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-81969c9f-cd4c-4da5-9c6c-1143abc4be7c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:38.998956 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-81969c9f-cd4c-4da5-9c6c-1143abc4be7c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:38.999751 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-81969c9f-cd4c-4da5-9c6c-1143abc4be7c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:39.000346 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-81969c9f-cd4c-4da5-9c6c-1143abc4be7c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:39.079993 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-85aefd60-59e2-4783-a476-0bc42aa2bc16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:39.080606 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-85aefd60-59e2-4783-a476-0bc42aa2bc16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:39.087938 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85aefd60-59e2-4783-a476-0bc42aa2bc16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:39.088409 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85aefd60-59e2-4783-a476-0bc42aa2bc16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:39.089184 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85aefd60-59e2-4783-a476-0bc42aa2bc16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:39.089617 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85aefd60-59e2-4783-a476-0bc42aa2bc16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:39.252989 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-81969c9f-cd4c-4da5-9c6c-1143abc4be7c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:39.262305 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-81969c9f-cd4c-4da5-9c6c-1143abc4be7c tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.278508 Feb 28 19:03:39.263045 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 122/243] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:38 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:39.330591 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-85aefd60-59e2-4783-a476-0bc42aa2bc16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:39.339103 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-85aefd60-59e2-4783-a476-0bc42aa2bc16 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.262756 Feb 28 19:03:39.339787 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 122/244] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:39 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:40.279827 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6353beb9-3ea2-4ff3-ada3-d10ba034ecf9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:40.280390 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6353beb9-3ea2-4ff3-ada3-d10ba034ecf9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:40.287777 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6353beb9-3ea2-4ff3-ada3-d10ba034ecf9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:40.288232 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6353beb9-3ea2-4ff3-ada3-d10ba034ecf9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:40.289724 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6353beb9-3ea2-4ff3-ada3-d10ba034ecf9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:40.290653 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6353beb9-3ea2-4ff3-ada3-d10ba034ecf9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:40.358260 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-34077a03-c259-433e-8008-1a6f341a5390 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:40.358877 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-34077a03-c259-433e-8008-1a6f341a5390 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:40.366071 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-34077a03-c259-433e-8008-1a6f341a5390 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:40.366513 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-34077a03-c259-433e-8008-1a6f341a5390 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:40.367314 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-34077a03-c259-433e-8008-1a6f341a5390 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:40.367749 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-34077a03-c259-433e-8008-1a6f341a5390 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:40.548993 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6353beb9-3ea2-4ff3-ada3-d10ba034ecf9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:40.557442 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6353beb9-3ea2-4ff3-ada3-d10ba034ecf9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.281358 Feb 28 19:03:40.558077 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 123/245] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:40 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:40.613306 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-34077a03-c259-433e-8008-1a6f341a5390 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:40.621958 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-34077a03-c259-433e-8008-1a6f341a5390 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.268434 Feb 28 19:03:40.622515 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 123/246] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:40 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:41.573664 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-bf1be8fc-b29b-4493-96e6-ed97618dd65f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:41.574273 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-bf1be8fc-b29b-4493-96e6-ed97618dd65f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:41.581511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf1be8fc-b29b-4493-96e6-ed97618dd65f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:41.581962 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf1be8fc-b29b-4493-96e6-ed97618dd65f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:41.582724 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf1be8fc-b29b-4493-96e6-ed97618dd65f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:41.583183 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf1be8fc-b29b-4493-96e6-ed97618dd65f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:41.638603 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-72dc2eb9-596c-4585-8b7f-a7920eeb9f8a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:41.639259 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-72dc2eb9-596c-4585-8b7f-a7920eeb9f8a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:41.646359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72dc2eb9-596c-4585-8b7f-a7920eeb9f8a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:41.646803 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72dc2eb9-596c-4585-8b7f-a7920eeb9f8a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:41.647605 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72dc2eb9-596c-4585-8b7f-a7920eeb9f8a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:41.648032 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72dc2eb9-596c-4585-8b7f-a7920eeb9f8a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:41.823529 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-bf1be8fc-b29b-4493-96e6-ed97618dd65f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:41.831902 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-bf1be8fc-b29b-4493-96e6-ed97618dd65f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.261931 Feb 28 19:03:41.832572 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 124/247] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:41 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:41.894813 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-72dc2eb9-596c-4585-8b7f-a7920eeb9f8a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:41.903588 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-72dc2eb9-596c-4585-8b7f-a7920eeb9f8a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.268718 Feb 28 19:03:41.904157 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 124/248] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:41 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:42.849171 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1df0f339-c1de-41ae-92d2-f4d146d01ce3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:42.849782 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1df0f339-c1de-41ae-92d2-f4d146d01ce3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:42.857540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1df0f339-c1de-41ae-92d2-f4d146d01ce3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:42.857992 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1df0f339-c1de-41ae-92d2-f4d146d01ce3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:42.858778 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1df0f339-c1de-41ae-92d2-f4d146d01ce3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:42.859240 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1df0f339-c1de-41ae-92d2-f4d146d01ce3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:42.920796 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0abc9491-2947-410a-a9dc-cedbc3257e23 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:42.921400 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0abc9491-2947-410a-a9dc-cedbc3257e23 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:42.928769 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0abc9491-2947-410a-a9dc-cedbc3257e23 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:42.929214 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0abc9491-2947-410a-a9dc-cedbc3257e23 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:42.930905 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0abc9491-2947-410a-a9dc-cedbc3257e23 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:42.931375 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0abc9491-2947-410a-a9dc-cedbc3257e23 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:43.104826 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1df0f339-c1de-41ae-92d2-f4d146d01ce3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:43.113008 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1df0f339-c1de-41ae-92d2-f4d146d01ce3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.267577 Feb 28 19:03:43.113580 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 125/249] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:42 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:43.175646 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0abc9491-2947-410a-a9dc-cedbc3257e23 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:43.184870 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0abc9491-2947-410a-a9dc-cedbc3257e23 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.267830 Feb 28 19:03:43.185523 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 125/250] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:42 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:44.129462 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-bc603fac-63d6-46d0-adec-e0079e4d6ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:44.130002 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-bc603fac-63d6-46d0-adec-e0079e4d6ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:44.137922 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bc603fac-63d6-46d0-adec-e0079e4d6ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:44.138359 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bc603fac-63d6-46d0-adec-e0079e4d6ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:44.139129 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bc603fac-63d6-46d0-adec-e0079e4d6ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:44.139568 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bc603fac-63d6-46d0-adec-e0079e4d6ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:44.202719 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1a1fac13-0755-47cc-92d4-24a5626adc06 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:44.203473 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1a1fac13-0755-47cc-92d4-24a5626adc06 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:44.215939 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a1fac13-0755-47cc-92d4-24a5626adc06 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:44.216668 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a1fac13-0755-47cc-92d4-24a5626adc06 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:44.217519 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a1fac13-0755-47cc-92d4-24a5626adc06 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:44.218016 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a1fac13-0755-47cc-92d4-24a5626adc06 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:44.392247 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-bc603fac-63d6-46d0-adec-e0079e4d6ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:44.401327 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-bc603fac-63d6-46d0-adec-e0079e4d6ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.275580 Feb 28 19:03:44.401898 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 126/251] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:44 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:44.463654 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1a1fac13-0755-47cc-92d4-24a5626adc06 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:44.471757 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1a1fac13-0755-47cc-92d4-24a5626adc06 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.273223 Feb 28 19:03:44.472318 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 126/252] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:44 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:45.417656 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-84db0a71-5037-45a6-9e28-84a14ecb2827 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:45.418254 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-84db0a71-5037-45a6-9e28-84a14ecb2827 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:45.425704 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-84db0a71-5037-45a6-9e28-84a14ecb2827 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:45.426145 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-84db0a71-5037-45a6-9e28-84a14ecb2827 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:45.426900 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-84db0a71-5037-45a6-9e28-84a14ecb2827 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:45.427361 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-84db0a71-5037-45a6-9e28-84a14ecb2827 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:45.488672 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-72455852-df0d-496d-8f97-7ab020b75d42 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:45.489207 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-72455852-df0d-496d-8f97-7ab020b75d42 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:45.497108 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72455852-df0d-496d-8f97-7ab020b75d42 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:45.497555 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72455852-df0d-496d-8f97-7ab020b75d42 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:45.498331 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72455852-df0d-496d-8f97-7ab020b75d42 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:45.498762 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72455852-df0d-496d-8f97-7ab020b75d42 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:45.731427 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-84db0a71-5037-45a6-9e28-84a14ecb2827 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:45.739467 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-84db0a71-5037-45a6-9e28-84a14ecb2827 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.325389 Feb 28 19:03:45.739979 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 127/253] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:45 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:45.800506 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-72455852-df0d-496d-8f97-7ab020b75d42 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:45.809128 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-72455852-df0d-496d-8f97-7ab020b75d42 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.324155 Feb 28 19:03:45.809703 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 127/254] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:45 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:46.756636 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-55a90adc-416f-4482-b505-82baceec9a63 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:46.757237 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-55a90adc-416f-4482-b505-82baceec9a63 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:46.765469 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-55a90adc-416f-4482-b505-82baceec9a63 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:46.765915 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-55a90adc-416f-4482-b505-82baceec9a63 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:46.766680 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-55a90adc-416f-4482-b505-82baceec9a63 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:46.767133 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-55a90adc-416f-4482-b505-82baceec9a63 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:46.825908 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a5e88264-b561-4e84-a905-882e44e14a22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:46.826551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a5e88264-b561-4e84-a905-882e44e14a22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:46.833893 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5e88264-b561-4e84-a905-882e44e14a22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:46.834345 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5e88264-b561-4e84-a905-882e44e14a22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:46.835136 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5e88264-b561-4e84-a905-882e44e14a22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:46.835576 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5e88264-b561-4e84-a905-882e44e14a22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:47.006066 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-55a90adc-416f-4482-b505-82baceec9a63 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:47.014842 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-55a90adc-416f-4482-b505-82baceec9a63 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.261770 Feb 28 19:03:47.015379 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 128/255] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:46 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:47.074737 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a5e88264-b561-4e84-a905-882e44e14a22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:47.082887 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a5e88264-b561-4e84-a905-882e44e14a22 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.260656 Feb 28 19:03:47.083491 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 128/256] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:46 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:47.685649 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-498baec7-f348-4b37-8400-41e7ba3056b9 req-c4c69b76-2514-4cee-b805-3374eb237236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fea77b98-2b78-485a-beab-edf47a4fcc72", "name": "network-vif-plugged", "status": "completed", "tag": "4446a787-0e66-4e50-9cbc-2341e7399a85"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:03:47.687354 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:03:47.687354 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:03:47.695522 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-498baec7-f348-4b37-8400-41e7ba3056b9 req-c4c69b76-2514-4cee-b805-3374eb237236 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:47.695989 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-498baec7-f348-4b37-8400-41e7ba3056b9 req-c4c69b76-2514-4cee-b805-3374eb237236 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:47.711967 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-498baec7-f348-4b37-8400-41e7ba3056b9 req-c4c69b76-2514-4cee-b805-3374eb237236 service nova] Creating event network-vif-plugged:4446a787-0e66-4e50-9cbc-2341e7399a85 for instance fea77b98-2b78-485a-beab-edf47a4fcc72 on hv-cinder-83118 Feb 28 19:03:47.716551 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-498baec7-f348-4b37-8400-41e7ba3056b9 req-c4c69b76-2514-4cee-b805-3374eb237236 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034607 Feb 28 19:03:47.717125 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 129/257] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:03:48.096061 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-734a3454-81e0-4c91-8de4-98b192e57a79 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:48.096061 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-734a3454-81e0-4c91-8de4-98b192e57a79 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:48.096061 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-734a3454-81e0-4c91-8de4-98b192e57a79 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:48.096061 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-734a3454-81e0-4c91-8de4-98b192e57a79 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:48.096804 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-734a3454-81e0-4c91-8de4-98b192e57a79 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:48.096804 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-734a3454-81e0-4c91-8de4-98b192e57a79 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:48.100397 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cbbb68e6-1e42-444e-ad60-32de1253b7a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:48.100845 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-cbbb68e6-1e42-444e-ad60-32de1253b7a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:48.109830 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cbbb68e6-1e42-444e-ad60-32de1253b7a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:48.109830 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cbbb68e6-1e42-444e-ad60-32de1253b7a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:48.112000 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cbbb68e6-1e42-444e-ad60-32de1253b7a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:48.112500 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cbbb68e6-1e42-444e-ad60-32de1253b7a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:48.295180 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-734a3454-81e0-4c91-8de4-98b192e57a79 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:48.315750 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-734a3454-81e0-4c91-8de4-98b192e57a79 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.287441 Feb 28 19:03:48.318050 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 129/258] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:48 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:48.373250 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cbbb68e6-1e42-444e-ad60-32de1253b7a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:48.381660 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-cbbb68e6-1e42-444e-ad60-32de1253b7a7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.285772 Feb 28 19:03:48.382228 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 130/259] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:48 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:49.332991 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-72a70ce1-1705-46cc-9e68-d54fa7910fa3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:49.333607 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-72a70ce1-1705-46cc-9e68-d54fa7910fa3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:49.342143 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72a70ce1-1705-46cc-9e68-d54fa7910fa3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:49.342587 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72a70ce1-1705-46cc-9e68-d54fa7910fa3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:49.343460 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72a70ce1-1705-46cc-9e68-d54fa7910fa3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:49.343990 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72a70ce1-1705-46cc-9e68-d54fa7910fa3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:49.402821 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9fcbd66d-b258-4403-a198-3ea782206068 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:49.403690 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9fcbd66d-b258-4403-a198-3ea782206068 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:49.411129 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9fcbd66d-b258-4403-a198-3ea782206068 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:49.413045 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9fcbd66d-b258-4403-a198-3ea782206068 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:49.413045 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9fcbd66d-b258-4403-a198-3ea782206068 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:49.415204 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9fcbd66d-b258-4403-a198-3ea782206068 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:49.584218 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-72a70ce1-1705-46cc-9e68-d54fa7910fa3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:49.593300 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-72a70ce1-1705-46cc-9e68-d54fa7910fa3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.263822 Feb 28 19:03:49.602646 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 130/260] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:49 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:49.658014 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9fcbd66d-b258-4403-a198-3ea782206068 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:49.666295 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9fcbd66d-b258-4403-a198-3ea782206068 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.268318 Feb 28 19:03:49.667084 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 131/261] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:49 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:50.609964 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ccfa6dc0-5f13-4e24-b733-0add24b917b9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:50.610513 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ccfa6dc0-5f13-4e24-b733-0add24b917b9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:50.617698 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ccfa6dc0-5f13-4e24-b733-0add24b917b9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:50.618141 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ccfa6dc0-5f13-4e24-b733-0add24b917b9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:50.618899 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ccfa6dc0-5f13-4e24-b733-0add24b917b9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:50.619357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ccfa6dc0-5f13-4e24-b733-0add24b917b9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:50.683446 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d97d7581-f926-4f5b-a503-566508dee3ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:50.684085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d97d7581-f926-4f5b-a503-566508dee3ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:50.691362 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d97d7581-f926-4f5b-a503-566508dee3ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:50.691811 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d97d7581-f926-4f5b-a503-566508dee3ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:50.692582 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d97d7581-f926-4f5b-a503-566508dee3ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:50.693017 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d97d7581-f926-4f5b-a503-566508dee3ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:50.857551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ccfa6dc0-5f13-4e24-b733-0add24b917b9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:50.868592 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ccfa6dc0-5f13-4e24-b733-0add24b917b9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.262239 Feb 28 19:03:50.869086 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 131/262] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:50 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:50.931166 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d97d7581-f926-4f5b-a503-566508dee3ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:50.939391 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d97d7581-f926-4f5b-a503-566508dee3ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.259753 Feb 28 19:03:50.940000 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 132/263] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:50 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:51.885721 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cd903327-e3e4-48c7-97c1-b85b7dbbda03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:51.886368 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-cd903327-e3e4-48c7-97c1-b85b7dbbda03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:51.893976 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cd903327-e3e4-48c7-97c1-b85b7dbbda03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:51.894424 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cd903327-e3e4-48c7-97c1-b85b7dbbda03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:51.895222 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cd903327-e3e4-48c7-97c1-b85b7dbbda03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:51.895654 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cd903327-e3e4-48c7-97c1-b85b7dbbda03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:51.956698 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-de871063-65fc-447b-8cac-18348016b662 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:51.957520 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-de871063-65fc-447b-8cac-18348016b662 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:51.965142 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de871063-65fc-447b-8cac-18348016b662 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:51.965694 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de871063-65fc-447b-8cac-18348016b662 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:51.966539 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de871063-65fc-447b-8cac-18348016b662 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:51.967045 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de871063-65fc-447b-8cac-18348016b662 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:52.139639 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-cd903327-e3e4-48c7-97c1-b85b7dbbda03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:52.147716 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-cd903327-e3e4-48c7-97c1-b85b7dbbda03 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.266116 Feb 28 19:03:52.148294 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 132/264] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:51 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:52.205686 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-de871063-65fc-447b-8cac-18348016b662 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:52.214104 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-de871063-65fc-447b-8cac-18348016b662 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.261030 Feb 28 19:03:52.214670 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 133/265] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:51 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:53.165877 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f54e9fa7-1095-4be6-bb3f-12021d723e19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:53.166481 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f54e9fa7-1095-4be6-bb3f-12021d723e19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:53.174255 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f54e9fa7-1095-4be6-bb3f-12021d723e19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:53.174696 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f54e9fa7-1095-4be6-bb3f-12021d723e19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:53.175584 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f54e9fa7-1095-4be6-bb3f-12021d723e19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:53.176020 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f54e9fa7-1095-4be6-bb3f-12021d723e19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:53.230624 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6fd948e8-93a6-4934-b6c9-a86b88f59a7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:53.231257 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6fd948e8-93a6-4934-b6c9-a86b88f59a7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:53.238349 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6fd948e8-93a6-4934-b6c9-a86b88f59a7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:53.238725 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6fd948e8-93a6-4934-b6c9-a86b88f59a7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:53.239528 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6fd948e8-93a6-4934-b6c9-a86b88f59a7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:53.239965 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6fd948e8-93a6-4934-b6c9-a86b88f59a7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:53.428764 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f54e9fa7-1095-4be6-bb3f-12021d723e19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:53.436877 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f54e9fa7-1095-4be6-bb3f-12021d723e19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.274714 Feb 28 19:03:53.437445 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 133/266] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:53 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:53.489875 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6fd948e8-93a6-4934-b6c9-a86b88f59a7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:53.498638 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6fd948e8-93a6-4934-b6c9-a86b88f59a7d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.271757 Feb 28 19:03:53.499220 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 134/267] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:53 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:54.453555 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6d93ec47-80ef-4ce7-978e-fc343f401cd6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:54.454160 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-6d93ec47-80ef-4ce7-978e-fc343f401cd6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:54.462164 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6d93ec47-80ef-4ce7-978e-fc343f401cd6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:54.462667 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6d93ec47-80ef-4ce7-978e-fc343f401cd6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:54.463448 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6d93ec47-80ef-4ce7-978e-fc343f401cd6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:54.463878 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6d93ec47-80ef-4ce7-978e-fc343f401cd6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:54.516424 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-038dbf2c-9421-4807-bd9d-4567fd8c27cc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:54.516975 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-038dbf2c-9421-4807-bd9d-4567fd8c27cc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:54.525482 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-038dbf2c-9421-4807-bd9d-4567fd8c27cc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:54.526216 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-038dbf2c-9421-4807-bd9d-4567fd8c27cc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:54.527058 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-038dbf2c-9421-4807-bd9d-4567fd8c27cc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:54.528706 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-038dbf2c-9421-4807-bd9d-4567fd8c27cc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:54.735999 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6d93ec47-80ef-4ce7-978e-fc343f401cd6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:54.744674 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6d93ec47-80ef-4ce7-978e-fc343f401cd6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1316 microversion: 2.1 time: 0.294741 Feb 28 19:03:54.751189 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 134/268] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:54 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:54.802150 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-038dbf2c-9421-4807-bd9d-4567fd8c27cc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:54.810508 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-038dbf2c-9421-4807-bd9d-4567fd8c27cc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.297826 Feb 28 19:03:54.819964 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 135/269] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:54 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:03:55.762584 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-04ce847f-3206-4d5f-a204-1e18da0770af tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:55.763215 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-04ce847f-3206-4d5f-a204-1e18da0770af tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:55.770477 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-04ce847f-3206-4d5f-a204-1e18da0770af tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:55.770925 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-04ce847f-3206-4d5f-a204-1e18da0770af tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:55.771727 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-04ce847f-3206-4d5f-a204-1e18da0770af tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:55.772156 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-04ce847f-3206-4d5f-a204-1e18da0770af tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:55.821682 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1319753823", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "networks": [{"uuid": "77db8b85-5a3d-4493-8542-d665273d50c5"}]}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:03:55.887825 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] validate_networks() for [('77db8b85-5a3d-4493-8542-d665273d50c5', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:03:56.185697 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-04ce847f-3206-4d5f-a204-1e18da0770af tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:56.194136 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-04ce847f-3206-4d5f-a204-1e18da0770af tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1506 microversion: 2.1 time: 0.435979 Feb 28 19:03:56.194724 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 135/270] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:55 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:56.199828 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-783a0789-a0f6-40bb-baf4-a9a188f178aa tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:56.200510 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-783a0789-a0f6-40bb-baf4-a9a188f178aa tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:56.209400 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-783a0789-a0f6-40bb-baf4-a9a188f178aa tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:56.209853 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-783a0789-a0f6-40bb-baf4-a9a188f178aa tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:56.211612 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-783a0789-a0f6-40bb-baf4-a9a188f178aa tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:56.212062 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-783a0789-a0f6-40bb-baf4-a9a188f178aa tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:56.596882 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-783a0789-a0f6-40bb-baf4-a9a188f178aa tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:56.609261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-783a0789-a0f6-40bb-baf4-a9a188f178aa tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.412936 Feb 28 19:03:56.610014 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 136/271] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:56 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:56.612548 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:03:56.612971 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:03:56.613440 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:03:56.613845 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:03:56.614254 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:03:56.623126 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:56.623579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:56.624374 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:56.624800 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:56.641893 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Getting quotas for project 1bdeeae6a56d4607962f8b0a1490547a. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:03:56.645729 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Getting quotas for user 3484bc7ebe7d4ddd972788b2ce5434ff and project 1bdeeae6a56d4607962f8b0a1490547a. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:03:56.656071 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:03:56.658317 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:03:56.899733 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2cf16598-701a-44e9-acb6-e3d9e20b55df tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083744 Feb 28 19:03:56.900421 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 136/272] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:03:56.910088 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7b0b63e3-2b28-4707-b6ce-df2ed830abb0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:56.910801 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7b0b63e3-2b28-4707-b6ce-df2ed830abb0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:56.982086 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7b0b63e3-2b28-4707-b6ce-df2ed830abb0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:56.990590 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7b0b63e3-2b28-4707-b6ce-df2ed830abb0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1214 microversion: 2.1 time: 0.084143 Feb 28 19:03:56.996222 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 137/273] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:56 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:57.628344 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ddefadc9-b085-4903-a4e0-efd9531bc42f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:57.628958 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ddefadc9-b085-4903-a4e0-efd9531bc42f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:57.637909 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ddefadc9-b085-4903-a4e0-efd9531bc42f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:57.638579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ddefadc9-b085-4903-a4e0-efd9531bc42f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:57.639589 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ddefadc9-b085-4903-a4e0-efd9531bc42f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:57.640181 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ddefadc9-b085-4903-a4e0-efd9531bc42f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:57.857783 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ddefadc9-b085-4903-a4e0-efd9531bc42f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:57.866059 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ddefadc9-b085-4903-a4e0-efd9531bc42f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1499 microversion: 2.1 time: 0.241491 Feb 28 19:03:57.866622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 137/274] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:57 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1499 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:57.882913 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-200cfb96-4b48-4748-95a2-911b4e22ddc7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd77d455-46c2-4753-8d7d-685216e5b3d4"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:03:57.884016 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-200cfb96-4b48-4748-95a2-911b4e22ddc7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:57.891698 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-200cfb96-4b48-4748-95a2-911b4e22ddc7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:57.892148 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-200cfb96-4b48-4748-95a2-911b4e22ddc7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:57.892909 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-200cfb96-4b48-4748-95a2-911b4e22ddc7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:57.893343 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-200cfb96-4b48-4748-95a2-911b4e22ddc7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:57.950655 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-200cfb96-4b48-4748-95a2-911b4e22ddc7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] HTTP exception thrown: Cannot 'attach_volume' instance 26980bce-633e-4e70-9ebd-c1a38fb5cc4a while it is in vm_state rescued Feb 28 19:03:57.951958 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-200cfb96-4b48-4748-95a2-911b4e22ddc7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Returning 409 to user: Cannot 'attach_volume' instance 26980bce-633e-4e70-9ebd-c1a38fb5cc4a while it is in vm_state rescued {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:03:57.953045 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-200cfb96-4b48-4748-95a2-911b4e22ddc7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074195 Feb 28 19:03:57.954200 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 138/275] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:03:57 2022] POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 28 19:03:57.962709 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-214f7b27-d77d-4291-a30e-2658a64cb698 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:03:57.963375 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-214f7b27-d77d-4291-a30e-2658a64cb698 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:57.970934 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-214f7b27-d77d-4291-a30e-2658a64cb698 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:57.971429 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-214f7b27-d77d-4291-a30e-2658a64cb698 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:57.972201 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-214f7b27-d77d-4291-a30e-2658a64cb698 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:57.972637 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-214f7b27-d77d-4291-a30e-2658a64cb698 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:58.008355 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1c26883b-898a-4597-8f20-66ec9acd51da tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:58.009389 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1c26883b-898a-4597-8f20-66ec9acd51da tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:58.085226 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1c26883b-898a-4597-8f20-66ec9acd51da tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:58.105904 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1c26883b-898a-4597-8f20-66ec9acd51da tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1214 microversion: 2.1 time: 0.101468 Feb 28 19:03:58.106576 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 139/276] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:58 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:58.290976 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-214f7b27-d77d-4291-a30e-2658a64cb698 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/action" status: 202 len: 0 microversion: 2.1 time: 0.332033 Feb 28 19:03:58.291652 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 138/277] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:03:57 2022] POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 28 19:03:58.299643 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ab4a215b-0c6c-4766-a856-0a160a270a89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:58.300282 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ab4a215b-0c6c-4766-a856-0a160a270a89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:58.308380 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ab4a215b-0c6c-4766-a856-0a160a270a89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:58.308826 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ab4a215b-0c6c-4766-a856-0a160a270a89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:58.309596 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ab4a215b-0c6c-4766-a856-0a160a270a89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:58.310026 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ab4a215b-0c6c-4766-a856-0a160a270a89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:58.532943 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ab4a215b-0c6c-4766-a856-0a160a270a89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:58.541912 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ab4a215b-0c6c-4766-a856-0a160a270a89 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1507 microversion: 2.1 time: 0.245807 Feb 28 19:03:58.542575 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 140/278] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:58 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:59.123339 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ecc11310-2967-413f-ac2a-44c71dee2a74 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:59.124063 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ecc11310-2967-413f-ac2a-44c71dee2a74 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:59.132585 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ecc11310-2967-413f-ac2a-44c71dee2a74 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:59.133105 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ecc11310-2967-413f-ac2a-44c71dee2a74 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:59.133940 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ecc11310-2967-413f-ac2a-44c71dee2a74 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:59.134371 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ecc11310-2967-413f-ac2a-44c71dee2a74 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:59.250615 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ecc11310-2967-413f-ac2a-44c71dee2a74 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:59.259254 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ecc11310-2967-413f-ac2a-44c71dee2a74 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1266 microversion: 2.1 time: 0.139947 Feb 28 19:03:59.259823 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 139/279] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:59 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:59.560492 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-bd19c335-6137-42bf-9e48-aae8bdd826e0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:03:59.561088 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-bd19c335-6137-42bf-9e48-aae8bdd826e0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:59.568225 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bd19c335-6137-42bf-9e48-aae8bdd826e0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:59.568773 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bd19c335-6137-42bf-9e48-aae8bdd826e0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:59.569532 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bd19c335-6137-42bf-9e48-aae8bdd826e0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:59.569972 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bd19c335-6137-42bf-9e48-aae8bdd826e0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:59.772300 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9ed4a900-4f9c-4953-a26b-ee7e48e933c9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9162e9b0-30f6-480d-a2ce-0d9d7ca329c5"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:03:59.772702 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bd19c335-6137-42bf-9e48-aae8bdd826e0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:03:59.774100 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9ed4a900-4f9c-4953-a26b-ee7e48e933c9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:03:59.781503 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9ed4a900-4f9c-4953-a26b-ee7e48e933c9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:59.781683 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-bd19c335-6137-42bf-9e48-aae8bdd826e0 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1507 microversion: 2.1 time: 0.225060 Feb 28 19:03:59.781953 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9ed4a900-4f9c-4953-a26b-ee7e48e933c9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:03:59.782168 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 141/280] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:03:59 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:03:59.782727 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9ed4a900-4f9c-4953-a26b-ee7e48e933c9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:03:59.783256 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9ed4a900-4f9c-4953-a26b-ee7e48e933c9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:00.277367 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1a5cb202-f91d-4b0b-a89d-0a4be75c36d2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:00.278416 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1a5cb202-f91d-4b0b-a89d-0a4be75c36d2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:00.286929 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a5cb202-f91d-4b0b-a89d-0a4be75c36d2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:00.293472 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a5cb202-f91d-4b0b-a89d-0a4be75c36d2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:00.293472 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a5cb202-f91d-4b0b-a89d-0a4be75c36d2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:00.293472 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a5cb202-f91d-4b0b-a89d-0a4be75c36d2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:00.411393 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1a5cb202-f91d-4b0b-a89d-0a4be75c36d2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:00.421258 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1a5cb202-f91d-4b0b-a89d-0a4be75c36d2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1284 microversion: 2.1 time: 0.147942 Feb 28 19:04:00.421842 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 142/281] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:00 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:00.805960 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-bfd4ff38-32fa-4faf-91cc-d616132ff307 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:00.805960 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-bfd4ff38-32fa-4faf-91cc-d616132ff307 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:00.810694 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bfd4ff38-32fa-4faf-91cc-d616132ff307 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:00.811375 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bfd4ff38-32fa-4faf-91cc-d616132ff307 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:00.812519 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bfd4ff38-32fa-4faf-91cc-d616132ff307 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:00.813155 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bfd4ff38-32fa-4faf-91cc-d616132ff307 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:00.971630 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9ed4a900-4f9c-4953-a26b-ee7e48e933c9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "POST /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.202927 Feb 28 19:04:00.972508 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 140/282] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:03:59 2022] POST /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments => generated 194 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:04:01.070184 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bfd4ff38-32fa-4faf-91cc-d616132ff307 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:01.087647 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-bfd4ff38-32fa-4faf-91cc-d616132ff307 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1507 microversion: 2.1 time: 0.283093 Feb 28 19:04:01.088364 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 143/283] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:00 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:01.440116 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-3463da5a-a4cc-4cb1-b4d5-233fd2e5c6cf tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:01.441076 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3463da5a-a4cc-4cb1-b4d5-233fd2e5c6cf tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:01.449991 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3463da5a-a4cc-4cb1-b4d5-233fd2e5c6cf tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:01.450418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3463da5a-a4cc-4cb1-b4d5-233fd2e5c6cf tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:01.451222 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3463da5a-a4cc-4cb1-b4d5-233fd2e5c6cf tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:01.451655 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3463da5a-a4cc-4cb1-b4d5-233fd2e5c6cf tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:01.649968 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-3463da5a-a4cc-4cb1-b4d5-233fd2e5c6cf tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:01.657944 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-3463da5a-a4cc-4cb1-b4d5-233fd2e5c6cf tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.222436 Feb 28 19:04:01.658514 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 141/284] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:01 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:02.104766 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0a8f2635-f827-4c22-aa94-3e6a782a4299 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:02.105368 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0a8f2635-f827-4c22-aa94-3e6a782a4299 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:02.112557 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a8f2635-f827-4c22-aa94-3e6a782a4299 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:02.112995 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a8f2635-f827-4c22-aa94-3e6a782a4299 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:02.113748 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a8f2635-f827-4c22-aa94-3e6a782a4299 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:02.114173 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a8f2635-f827-4c22-aa94-3e6a782a4299 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:02.469869 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0a8f2635-f827-4c22-aa94-3e6a782a4299 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:02.478196 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0a8f2635-f827-4c22-aa94-3e6a782a4299 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1507 microversion: 2.1 time: 0.377718 Feb 28 19:04:02.478769 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 144/285] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:02 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:02.650680 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-28c8ba1a-f789-43f0-8434-fc29749912c4 req-173e7ec0-9ed1-4d89-922d-8c5d2a0933e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af024eef-b2ab-4438-a2b8-74b5b4848624", "tag": "d582ddb5-9e56-41f0-8777-0be57ac14caa"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:02.652366 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:04:02.652366 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:04:02.661274 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-28c8ba1a-f789-43f0-8434-fc29749912c4 req-173e7ec0-9ed1-4d89-922d-8c5d2a0933e5 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:02.661793 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-28c8ba1a-f789-43f0-8434-fc29749912c4 req-173e7ec0-9ed1-4d89-922d-8c5d2a0933e5 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:02.676220 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8e0c6f1b-43b6-4fed-85ba-20bdbcc9b7dc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:02.676841 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8e0c6f1b-43b6-4fed-85ba-20bdbcc9b7dc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:02.680262 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-28c8ba1a-f789-43f0-8434-fc29749912c4 req-173e7ec0-9ed1-4d89-922d-8c5d2a0933e5 service nova] Creating event network-changed:d582ddb5-9e56-41f0-8777-0be57ac14caa for instance af024eef-b2ab-4438-a2b8-74b5b4848624 on hv-cinder-83118 Feb 28 19:04:02.683940 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-28c8ba1a-f789-43f0-8434-fc29749912c4 req-173e7ec0-9ed1-4d89-922d-8c5d2a0933e5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044018 Feb 28 19:04:02.684642 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 142/286] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:02.685023 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8e0c6f1b-43b6-4fed-85ba-20bdbcc9b7dc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:02.685482 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8e0c6f1b-43b6-4fed-85ba-20bdbcc9b7dc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:02.686262 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8e0c6f1b-43b6-4fed-85ba-20bdbcc9b7dc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:02.686694 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8e0c6f1b-43b6-4fed-85ba-20bdbcc9b7dc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:02.883750 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8e0c6f1b-43b6-4fed-85ba-20bdbcc9b7dc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:02.891744 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8e0c6f1b-43b6-4fed-85ba-20bdbcc9b7dc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.220135 Feb 28 19:04:02.892314 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 145/287] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:02 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:03.496017 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7a218608-0406-4fa3-a235-e9ca13d5d5ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:03.496641 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7a218608-0406-4fa3-a235-e9ca13d5d5ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:03.504047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7a218608-0406-4fa3-a235-e9ca13d5d5ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:03.504496 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7a218608-0406-4fa3-a235-e9ca13d5d5ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:03.505260 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7a218608-0406-4fa3-a235-e9ca13d5d5ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:03.505693 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7a218608-0406-4fa3-a235-e9ca13d5d5ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:03.701590 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7a218608-0406-4fa3-a235-e9ca13d5d5ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:03.709688 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7a218608-0406-4fa3-a235-e9ca13d5d5ed tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1507 microversion: 2.1 time: 0.218481 Feb 28 19:04:03.713567 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 143/288] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:03 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:03.908464 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4cb39ea2-fa72-4453-bdb3-0570fdea2d8d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:03.909077 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4cb39ea2-fa72-4453-bdb3-0570fdea2d8d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:03.917005 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4cb39ea2-fa72-4453-bdb3-0570fdea2d8d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:03.917452 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4cb39ea2-fa72-4453-bdb3-0570fdea2d8d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:03.918227 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4cb39ea2-fa72-4453-bdb3-0570fdea2d8d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:03.918660 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4cb39ea2-fa72-4453-bdb3-0570fdea2d8d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:04.109898 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4cb39ea2-fa72-4453-bdb3-0570fdea2d8d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:04.118555 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4cb39ea2-fa72-4453-bdb3-0570fdea2d8d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.213817 Feb 28 19:04:04.119135 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 146/289] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:03 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:04.728242 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-68a92db7-1984-455e-9c60-89ab3bac07f7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:04.728861 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-68a92db7-1984-455e-9c60-89ab3bac07f7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:04.736295 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-68a92db7-1984-455e-9c60-89ab3bac07f7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:04.736740 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-68a92db7-1984-455e-9c60-89ab3bac07f7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:04.737579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-68a92db7-1984-455e-9c60-89ab3bac07f7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:04.738153 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-68a92db7-1984-455e-9c60-89ab3bac07f7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:04.936082 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-68a92db7-1984-455e-9c60-89ab3bac07f7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:04.944486 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-68a92db7-1984-455e-9c60-89ab3bac07f7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1507 microversion: 2.1 time: 0.221159 Feb 28 19:04:04.945162 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 144/290] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:04 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:05.134883 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8c8c3819-d846-46ed-9dc8-2859dd0922b5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:05.135751 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8c8c3819-d846-46ed-9dc8-2859dd0922b5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:05.142889 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8c3819-d846-46ed-9dc8-2859dd0922b5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:05.143377 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8c3819-d846-46ed-9dc8-2859dd0922b5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:05.144152 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8c3819-d846-46ed-9dc8-2859dd0922b5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:05.144582 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8c3819-d846-46ed-9dc8-2859dd0922b5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:05.431789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8c8c3819-d846-46ed-9dc8-2859dd0922b5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:05.441094 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8c8c3819-d846-46ed-9dc8-2859dd0922b5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.310518 Feb 28 19:04:05.441686 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 147/291] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:05 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:05.962560 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-670563d9-e986-40a6-8ac3-2bc4621ac07b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:05.963193 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-670563d9-e986-40a6-8ac3-2bc4621ac07b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:05.970703 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-670563d9-e986-40a6-8ac3-2bc4621ac07b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:05.971188 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-670563d9-e986-40a6-8ac3-2bc4621ac07b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:05.971967 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-670563d9-e986-40a6-8ac3-2bc4621ac07b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:05.972402 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-670563d9-e986-40a6-8ac3-2bc4621ac07b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:06.167943 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-670563d9-e986-40a6-8ac3-2bc4621ac07b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:06.176243 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-670563d9-e986-40a6-8ac3-2bc4621ac07b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1513 microversion: 2.1 time: 0.218233 Feb 28 19:04:06.176813 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 145/292] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:05 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:06.465882 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-67658d7e-589e-498c-b84c-44c28dc361e9 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:06.467840 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-67658d7e-589e-498c-b84c-44c28dc361e9 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:06.473982 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-67658d7e-589e-498c-b84c-44c28dc361e9 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:06.474410 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-67658d7e-589e-498c-b84c-44c28dc361e9 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:06.475209 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-67658d7e-589e-498c-b84c-44c28dc361e9 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:06.475643 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-67658d7e-589e-498c-b84c-44c28dc361e9 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:06.684808 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-67658d7e-589e-498c-b84c-44c28dc361e9 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:06.693409 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-67658d7e-589e-498c-b84c-44c28dc361e9 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.231213 Feb 28 19:04:06.693969 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 148/293] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:06 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:07.710342 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-158ab035-7507-4d0d-9031-a29a155413a4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:07.711672 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-158ab035-7507-4d0d-9031-a29a155413a4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:07.719172 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-158ab035-7507-4d0d-9031-a29a155413a4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:07.720918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-158ab035-7507-4d0d-9031-a29a155413a4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:07.720918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-158ab035-7507-4d0d-9031-a29a155413a4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:07.720918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-158ab035-7507-4d0d-9031-a29a155413a4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:07.919357 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-158ab035-7507-4d0d-9031-a29a155413a4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:07.927774 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-158ab035-7507-4d0d-9031-a29a155413a4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.221296 Feb 28 19:04:07.928453 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 146/294] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:07 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:08.944395 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7a97d6e8-b188-4d27-8479-036d006e5aa4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:08.945025 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7a97d6e8-b188-4d27-8479-036d006e5aa4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:08.952462 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7a97d6e8-b188-4d27-8479-036d006e5aa4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:08.952906 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7a97d6e8-b188-4d27-8479-036d006e5aa4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:08.953727 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7a97d6e8-b188-4d27-8479-036d006e5aa4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:08.954164 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7a97d6e8-b188-4d27-8479-036d006e5aa4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:09.147343 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7a97d6e8-b188-4d27-8479-036d006e5aa4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:09.155899 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7a97d6e8-b188-4d27-8479-036d006e5aa4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.215180 Feb 28 19:04:09.156497 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 149/295] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:08 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:09.304932 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c12a1f80-21bc-4e0e-a496-1dc7f8046022 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:09.305539 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c12a1f80-21bc-4e0e-a496-1dc7f8046022 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:09.312633 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c12a1f80-21bc-4e0e-a496-1dc7f8046022 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:09.313079 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c12a1f80-21bc-4e0e-a496-1dc7f8046022 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:09.313842 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c12a1f80-21bc-4e0e-a496-1dc7f8046022 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:09.314269 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c12a1f80-21bc-4e0e-a496-1dc7f8046022 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:09.507172 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c12a1f80-21bc-4e0e-a496-1dc7f8046022 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:09.515316 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c12a1f80-21bc-4e0e-a496-1dc7f8046022 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1513 microversion: 2.1 time: 0.214314 Feb 28 19:04:09.515898 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 147/296] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:09 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:09.531795 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8b9236f8-b2c5-488c-9dee-86247e09769f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06a21a6b-aeb0-4fdc-ac3c-09daece69a70"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:09.532908 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8b9236f8-b2c5-488c-9dee-86247e09769f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:09.540941 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b9236f8-b2c5-488c-9dee-86247e09769f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:09.541400 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b9236f8-b2c5-488c-9dee-86247e09769f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:09.542171 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b9236f8-b2c5-488c-9dee-86247e09769f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:09.542606 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b9236f8-b2c5-488c-9dee-86247e09769f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:10.173141 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-bf49a628-8584-4e97-b231-39772bedb17c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:10.173746 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-bf49a628-8584-4e97-b231-39772bedb17c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:10.181345 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf49a628-8584-4e97-b231-39772bedb17c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:10.181790 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf49a628-8584-4e97-b231-39772bedb17c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:10.182552 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf49a628-8584-4e97-b231-39772bedb17c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:10.182985 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf49a628-8584-4e97-b231-39772bedb17c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:10.380184 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-bf49a628-8584-4e97-b231-39772bedb17c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:10.389195 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-bf49a628-8584-4e97-b231-39772bedb17c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.219670 Feb 28 19:04:10.389766 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 148/297] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:10 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:11.461046 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-5cf0c9c6-ec47-4325-9c31-656bd8b1b83f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:11.461805 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5cf0c9c6-ec47-4325-9c31-656bd8b1b83f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:11.470048 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5cf0c9c6-ec47-4325-9c31-656bd8b1b83f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:11.470494 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5cf0c9c6-ec47-4325-9c31-656bd8b1b83f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:11.471280 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5cf0c9c6-ec47-4325-9c31-656bd8b1b83f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:11.471709 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5cf0c9c6-ec47-4325-9c31-656bd8b1b83f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:11.666081 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-5cf0c9c6-ec47-4325-9c31-656bd8b1b83f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:11.674333 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-5cf0c9c6-ec47-4325-9c31-656bd8b1b83f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.217129 Feb 28 19:04:11.674889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 149/298] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:11 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:12.690930 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b347e647-9023-4902-9823-f0342112c8a8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:12.691599 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b347e647-9023-4902-9823-f0342112c8a8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:12.699303 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b347e647-9023-4902-9823-f0342112c8a8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:12.699747 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b347e647-9023-4902-9823-f0342112c8a8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:12.700500 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b347e647-9023-4902-9823-f0342112c8a8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:12.700930 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b347e647-9023-4902-9823-f0342112c8a8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:12.902699 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b347e647-9023-4902-9823-f0342112c8a8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:12.910599 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b347e647-9023-4902-9823-f0342112c8a8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.223326 Feb 28 19:04:12.911283 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 150/299] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:12 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:13.926762 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ae1ce370-7792-4210-bbfd-7059f39b8bc0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:13.927465 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ae1ce370-7792-4210-bbfd-7059f39b8bc0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:13.935106 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ae1ce370-7792-4210-bbfd-7059f39b8bc0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:13.935986 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ae1ce370-7792-4210-bbfd-7059f39b8bc0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:13.936831 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ae1ce370-7792-4210-bbfd-7059f39b8bc0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:13.937265 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ae1ce370-7792-4210-bbfd-7059f39b8bc0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:14.138897 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ae1ce370-7792-4210-bbfd-7059f39b8bc0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:14.147149 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ae1ce370-7792-4210-bbfd-7059f39b8bc0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.224089 Feb 28 19:04:14.148849 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 151/300] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:13 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:14.682200 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8b9236f8-b2c5-488c-9dee-86247e09769f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.153971 Feb 28 19:04:14.683100 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 150/301] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:04:09 2022] POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments => generated 194 bytes in 5156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:15.165645 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f3fda052-60bd-45f7-9dec-e2ba4c8acfed tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:15.166253 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f3fda052-60bd-45f7-9dec-e2ba4c8acfed tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:15.176848 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f3fda052-60bd-45f7-9dec-e2ba4c8acfed tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:15.177287 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f3fda052-60bd-45f7-9dec-e2ba4c8acfed tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:15.178057 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f3fda052-60bd-45f7-9dec-e2ba4c8acfed tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:15.178650 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f3fda052-60bd-45f7-9dec-e2ba4c8acfed tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:15.399781 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f3fda052-60bd-45f7-9dec-e2ba4c8acfed tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:15.408362 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f3fda052-60bd-45f7-9dec-e2ba4c8acfed tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.247071 Feb 28 19:04:15.408944 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 152/302] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:15 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:16.426791 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-500a790e-d0f5-485d-bbb3-9c7ee3aa88e5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:16.427506 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-500a790e-d0f5-485d-bbb3-9c7ee3aa88e5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:16.439026 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-500a790e-d0f5-485d-bbb3-9c7ee3aa88e5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:16.439370 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-500a790e-d0f5-485d-bbb3-9c7ee3aa88e5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:16.442463 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-500a790e-d0f5-485d-bbb3-9c7ee3aa88e5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:16.442463 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-500a790e-d0f5-485d-bbb3-9c7ee3aa88e5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:16.637682 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-500a790e-d0f5-485d-bbb3-9c7ee3aa88e5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:16.645976 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-500a790e-d0f5-485d-bbb3-9c7ee3aa88e5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.223854 Feb 28 19:04:16.646534 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 151/303] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:16 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:16.872932 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d82f46e5-7fd7-4f1e-ada1-ab095f7d245f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9162e9b0-30f6-480d-a2ce-0d9d7ca329c5"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:16.874290 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d82f46e5-7fd7-4f1e-ada1-ab095f7d245f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:16.882245 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d82f46e5-7fd7-4f1e-ada1-ab095f7d245f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:16.882765 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d82f46e5-7fd7-4f1e-ada1-ab095f7d245f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:16.883636 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d82f46e5-7fd7-4f1e-ada1-ab095f7d245f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:16.884143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d82f46e5-7fd7-4f1e-ada1-ab095f7d245f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:17.036954 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-d82f46e5-7fd7-4f1e-ada1-ab095f7d245f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] HTTP exception thrown: Invalid volume: volume 9162e9b0-30f6-480d-a2ce-0d9d7ca329c5 is already attached to instances: fea77b98-2b78-485a-beab-edf47a4fcc72 Feb 28 19:04:17.037565 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d82f46e5-7fd7-4f1e-ada1-ab095f7d245f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Returning 400 to user: Invalid volume: volume 9162e9b0-30f6-480d-a2ce-0d9d7ca329c5 is already attached to instances: fea77b98-2b78-485a-beab-edf47a4fcc72 {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:04:17.039085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d82f46e5-7fd7-4f1e-ada1-ab095f7d245f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "POST /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.169693 Feb 28 19:04:17.039758 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 153/304] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:04:16 2022] POST /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments => generated 174 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 28 19:04:17.134776 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-22313f70-3234-47c7-beeb-714a549c46eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:17.135304 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-22313f70-3234-47c7-beeb-714a549c46eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:17.142306 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-22313f70-3234-47c7-beeb-714a549c46eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:17.142746 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-22313f70-3234-47c7-beeb-714a549c46eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:17.143531 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-22313f70-3234-47c7-beeb-714a549c46eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:17.143961 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-22313f70-3234-47c7-beeb-714a549c46eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:17.293139 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-22313f70-3234-47c7-beeb-714a549c46eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lazy-loading 'services' on Instance uuid fea77b98-2b78-485a-beab-edf47a4fcc72 {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:04:17.662934 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1fb20690-fe6a-4a82-85fc-6ee26ea34a87 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:17.663954 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1fb20690-fe6a-4a82-85fc-6ee26ea34a87 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:17.671882 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1fb20690-fe6a-4a82-85fc-6ee26ea34a87 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:17.677257 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1fb20690-fe6a-4a82-85fc-6ee26ea34a87 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:17.677257 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1fb20690-fe6a-4a82-85fc-6ee26ea34a87 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:17.677257 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1fb20690-fe6a-4a82-85fc-6ee26ea34a87 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:17.677661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-22313f70-3234-47c7-beeb-714a549c46eb tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments/9162e9b0-30f6-480d-a2ce-0d9d7ca329c5" status: 202 len: 0 microversion: 2.1 time: 0.544364 Feb 28 19:04:17.677661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 152/305] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:04:17 2022] DELETE /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments/9162e9b0-30f6-480d-a2ce-0d9d7ca329c5 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:04:17.687353 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0697a45a-60df-403d-8bec-75681e29cd61 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:17.688763 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0697a45a-60df-403d-8bec-75681e29cd61 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:17.697154 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0697a45a-60df-403d-8bec-75681e29cd61 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:17.697677 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0697a45a-60df-403d-8bec-75681e29cd61 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:17.698519 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0697a45a-60df-403d-8bec-75681e29cd61 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:17.699190 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0697a45a-60df-403d-8bec-75681e29cd61 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:17.771684 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0697a45a-60df-403d-8bec-75681e29cd61 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088536 Feb 28 19:04:17.772402 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 153/306] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:17 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:04:17.890544 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1fb20690-fe6a-4a82-85fc-6ee26ea34a87 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:17.898985 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1fb20690-fe6a-4a82-85fc-6ee26ea34a87 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.239756 Feb 28 19:04:17.899571 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 154/307] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:17 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:18.783526 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-26adcf26-84f0-4c8a-8e0a-67ff8abb116a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:18.784353 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-26adcf26-84f0-4c8a-8e0a-67ff8abb116a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:18.791918 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-26adcf26-84f0-4c8a-8e0a-67ff8abb116a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:18.792357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-26adcf26-84f0-4c8a-8e0a-67ff8abb116a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:18.793110 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-26adcf26-84f0-4c8a-8e0a-67ff8abb116a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:18.793790 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-26adcf26-84f0-4c8a-8e0a-67ff8abb116a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:18.857678 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-26adcf26-84f0-4c8a-8e0a-67ff8abb116a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077957 Feb 28 19:04:18.858288 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 154/308] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:18 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:18.915844 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-3d7835d1-d9e5-41be-b08e-6b2bb5cf4eeb tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:18.916457 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3d7835d1-d9e5-41be-b08e-6b2bb5cf4eeb tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:18.924356 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3d7835d1-d9e5-41be-b08e-6b2bb5cf4eeb tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:18.924807 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3d7835d1-d9e5-41be-b08e-6b2bb5cf4eeb tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:18.925580 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3d7835d1-d9e5-41be-b08e-6b2bb5cf4eeb tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:18.926011 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3d7835d1-d9e5-41be-b08e-6b2bb5cf4eeb tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:19.133560 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-3d7835d1-d9e5-41be-b08e-6b2bb5cf4eeb tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:19.141836 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-3d7835d1-d9e5-41be-b08e-6b2bb5cf4eeb tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.229585 Feb 28 19:04:19.142394 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 155/309] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:18 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:19.870470 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d12ea5df-121e-488f-ba2a-657979d062a4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:19.871466 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d12ea5df-121e-488f-ba2a-657979d062a4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:19.878710 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d12ea5df-121e-488f-ba2a-657979d062a4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:19.879186 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d12ea5df-121e-488f-ba2a-657979d062a4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:19.879968 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d12ea5df-121e-488f-ba2a-657979d062a4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:19.880402 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d12ea5df-121e-488f-ba2a-657979d062a4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:19.951894 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d12ea5df-121e-488f-ba2a-657979d062a4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082279 Feb 28 19:04:19.951894 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 155/310] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:19 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:20.056896 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-e774787a-ee2e-40cf-95eb-52544f9d16cf req-e8d09220-3f24-4354-b4c5-2d53e3513410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af024eef-b2ab-4438-a2b8-74b5b4848624", "name": "network-vif-plugged", "status": "completed", "tag": "d582ddb5-9e56-41f0-8777-0be57ac14caa"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:20.058670 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:04:20.058670 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:04:20.066650 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-e774787a-ee2e-40cf-95eb-52544f9d16cf req-e8d09220-3f24-4354-b4c5-2d53e3513410 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:20.067091 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-e774787a-ee2e-40cf-95eb-52544f9d16cf req-e8d09220-3f24-4354-b4c5-2d53e3513410 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:20.083769 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-e774787a-ee2e-40cf-95eb-52544f9d16cf req-e8d09220-3f24-4354-b4c5-2d53e3513410 service nova] Creating event network-vif-plugged:d582ddb5-9e56-41f0-8777-0be57ac14caa for instance af024eef-b2ab-4438-a2b8-74b5b4848624 on hv-cinder-83118 Feb 28 19:04:20.088588 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-e774787a-ee2e-40cf-95eb-52544f9d16cf req-e8d09220-3f24-4354-b4c5-2d53e3513410 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035903 Feb 28 19:04:20.089209 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 156/311] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:04:20.158457 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e2578e85-c0d9-4064-8c9f-b8719b48be27 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:20.159088 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e2578e85-c0d9-4064-8c9f-b8719b48be27 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:20.167258 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e2578e85-c0d9-4064-8c9f-b8719b48be27 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:20.167702 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e2578e85-c0d9-4064-8c9f-b8719b48be27 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:20.168815 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e2578e85-c0d9-4064-8c9f-b8719b48be27 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:20.169240 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e2578e85-c0d9-4064-8c9f-b8719b48be27 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:20.372984 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e2578e85-c0d9-4064-8c9f-b8719b48be27 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:20.380882 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e2578e85-c0d9-4064-8c9f-b8719b48be27 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.226035 Feb 28 19:04:20.381431 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 156/312] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:20 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:20.960105 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-40ae0a46-d0d3-473c-a0ac-35883ff8fc43 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:20.961511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-40ae0a46-d0d3-473c-a0ac-35883ff8fc43 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:20.969056 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40ae0a46-d0d3-473c-a0ac-35883ff8fc43 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:20.969607 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40ae0a46-d0d3-473c-a0ac-35883ff8fc43 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:20.970689 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40ae0a46-d0d3-473c-a0ac-35883ff8fc43 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:20.971320 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-40ae0a46-d0d3-473c-a0ac-35883ff8fc43 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:21.037209 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-40ae0a46-d0d3-473c-a0ac-35883ff8fc43 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081322 Feb 28 19:04:21.037707 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 157/313] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:20 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:21.398242 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f7d73e3e-60f5-4790-8f07-3480ea968ab6 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:21.398871 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f7d73e3e-60f5-4790-8f07-3480ea968ab6 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:21.405958 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7d73e3e-60f5-4790-8f07-3480ea968ab6 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:21.406402 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7d73e3e-60f5-4790-8f07-3480ea968ab6 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:21.407242 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7d73e3e-60f5-4790-8f07-3480ea968ab6 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:21.407670 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7d73e3e-60f5-4790-8f07-3480ea968ab6 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:21.611549 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f7d73e3e-60f5-4790-8f07-3480ea968ab6 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:21.619782 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f7d73e3e-60f5-4790-8f07-3480ea968ab6 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1314 microversion: 2.1 time: 0.225805 Feb 28 19:04:21.620338 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 157/314] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:21 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:22.048934 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a66588c6-7faf-4f6a-90ce-34cbfeaaaba6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:22.049957 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a66588c6-7faf-4f6a-90ce-34cbfeaaaba6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:22.058281 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a66588c6-7faf-4f6a-90ce-34cbfeaaaba6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:22.058755 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a66588c6-7faf-4f6a-90ce-34cbfeaaaba6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:22.060055 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a66588c6-7faf-4f6a-90ce-34cbfeaaaba6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:22.060055 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a66588c6-7faf-4f6a-90ce-34cbfeaaaba6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:22.128806 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a66588c6-7faf-4f6a-90ce-34cbfeaaaba6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083793 Feb 28 19:04:22.129296 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 158/315] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:22 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:22.637503 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-93027b0c-7e0c-457e-9f30-c2add0e662e8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:22.638035 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-93027b0c-7e0c-457e-9f30-c2add0e662e8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:22.645077 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-93027b0c-7e0c-457e-9f30-c2add0e662e8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:22.645518 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-93027b0c-7e0c-457e-9f30-c2add0e662e8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:22.646269 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-93027b0c-7e0c-457e-9f30-c2add0e662e8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:22.646695 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-93027b0c-7e0c-457e-9f30-c2add0e662e8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:22.917232 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-93027b0c-7e0c-457e-9f30-c2add0e662e8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:22.928140 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-93027b0c-7e0c-457e-9f30-c2add0e662e8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1499 microversion: 2.1 time: 0.294568 Feb 28 19:04:22.929525 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 158/316] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:22 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1499 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:23.140698 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-02a11ab1-ecc2-46df-93ce-fe4444a4d449 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:23.141630 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-02a11ab1-ecc2-46df-93ce-fe4444a4d449 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:23.150089 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-02a11ab1-ecc2-46df-93ce-fe4444a4d449 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:23.150554 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-02a11ab1-ecc2-46df-93ce-fe4444a4d449 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:23.151353 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-02a11ab1-ecc2-46df-93ce-fe4444a4d449 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:23.151781 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-02a11ab1-ecc2-46df-93ce-fe4444a4d449 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:23.216021 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-02a11ab1-ecc2-46df-93ce-fe4444a4d449 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078975 Feb 28 19:04:23.216588 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 159/317] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:23 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:24.227608 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c8fafcf5-0de6-4eca-9b7a-c64dbfd07eb8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:24.228677 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c8fafcf5-0de6-4eca-9b7a-c64dbfd07eb8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:24.236525 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c8fafcf5-0de6-4eca-9b7a-c64dbfd07eb8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:24.236972 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c8fafcf5-0de6-4eca-9b7a-c64dbfd07eb8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:24.237736 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c8fafcf5-0de6-4eca-9b7a-c64dbfd07eb8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:24.238174 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c8fafcf5-0de6-4eca-9b7a-c64dbfd07eb8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:24.242336 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f7965dae-1c38-4ca5-a80d-aba9743b4c9d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:24.247961 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f7965dae-1c38-4ca5-a80d-aba9743b4c9d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:24.251750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f7965dae-1c38-4ca5-a80d-aba9743b4c9d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:24.252287 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f7965dae-1c38-4ca5-a80d-aba9743b4c9d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:24.253065 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f7965dae-1c38-4ca5-a80d-aba9743b4c9d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:24.253499 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f7965dae-1c38-4ca5-a80d-aba9743b4c9d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:24.313608 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c8fafcf5-0de6-4eca-9b7a-c64dbfd07eb8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090035 Feb 28 19:04:24.314495 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 159/318] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:24 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:24.324080 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f7965dae-1c38-4ca5-a80d-aba9743b4c9d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Going to try to terminate instance {{(pid=101792) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:04:24.654050 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-97050fff-02e5-4970-9119-e05d31a4f767 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:24.655002 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-97050fff-02e5-4970-9119-e05d31a4f767 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:24.662117 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-97050fff-02e5-4970-9119-e05d31a4f767 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:24.662554 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-97050fff-02e5-4970-9119-e05d31a4f767 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:24.663848 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-97050fff-02e5-4970-9119-e05d31a4f767 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:24.664278 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-97050fff-02e5-4970-9119-e05d31a4f767 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:24.723897 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-97050fff-02e5-4970-9119-e05d31a4f767 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lazy-loading 'flavor' on Instance uuid 26980bce-633e-4e70-9ebd-c1a38fb5cc4a {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:04:24.731745 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f7965dae-1c38-4ca5-a80d-aba9743b4c9d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "DELETE /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 204 len: 0 microversion: 2.1 time: 0.493419 Feb 28 19:04:24.732367 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 160/319] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:04:24 2022] DELETE /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 28 19:04:24.760764 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2f6c56f7-b88b-4519-8af4-0fa612376684 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:24.761467 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2f6c56f7-b88b-4519-8af4-0fa612376684 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:24.770124 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2f6c56f7-b88b-4519-8af4-0fa612376684 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:24.770573 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2f6c56f7-b88b-4519-8af4-0fa612376684 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:24.771374 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2f6c56f7-b88b-4519-8af4-0fa612376684 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:24.771804 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2f6c56f7-b88b-4519-8af4-0fa612376684 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:25.008949 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2f6c56f7-b88b-4519-8af4-0fa612376684 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:25.017145 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2f6c56f7-b88b-4519-8af4-0fa612376684 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1505 microversion: 2.1 time: 0.277231 Feb 28 19:04:25.017942 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 161/320] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:24 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:25.281738 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-97050fff-02e5-4970-9119-e05d31a4f767 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/action" status: 200 len: 32 microversion: 2.1 time: 0.631432 Feb 28 19:04:25.290022 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 160/321] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:04:24 2022] POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/action => generated 32 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 28 19:04:25.296102 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-877d6f2c-965c-46af-a729-ce697a71cafb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:25.297269 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-877d6f2c-965c-46af-a729-ce697a71cafb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:25.305169 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-877d6f2c-965c-46af-a729-ce697a71cafb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:25.305834 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-877d6f2c-965c-46af-a729-ce697a71cafb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:25.306619 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-877d6f2c-965c-46af-a729-ce697a71cafb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:25.307051 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-877d6f2c-965c-46af-a729-ce697a71cafb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:25.325859 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d4cade57-be00-494a-b5aa-e1d08d844fcc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:25.326900 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d4cade57-be00-494a-b5aa-e1d08d844fcc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:25.334541 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d4cade57-be00-494a-b5aa-e1d08d844fcc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:25.335789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d4cade57-be00-494a-b5aa-e1d08d844fcc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:25.336748 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d4cade57-be00-494a-b5aa-e1d08d844fcc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:25.337324 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d4cade57-be00-494a-b5aa-e1d08d844fcc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:25.411943 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d4cade57-be00-494a-b5aa-e1d08d844fcc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090298 Feb 28 19:04:25.416472 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 161/322] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:25 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:04:25.517334 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-877d6f2c-965c-46af-a729-ce697a71cafb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:25.527059 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-877d6f2c-965c-46af-a729-ce697a71cafb tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.235463 Feb 28 19:04:25.537114 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 162/323] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:25 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:26.033503 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6e8b49a4-e57e-4d94-8428-da8bad21f000 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:26.034165 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-6e8b49a4-e57e-4d94-8428-da8bad21f000 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:26.042156 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6e8b49a4-e57e-4d94-8428-da8bad21f000 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:26.042663 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6e8b49a4-e57e-4d94-8428-da8bad21f000 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:26.043693 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6e8b49a4-e57e-4d94-8428-da8bad21f000 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:26.044343 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6e8b49a4-e57e-4d94-8428-da8bad21f000 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:26.256210 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6e8b49a4-e57e-4d94-8428-da8bad21f000 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:26.265352 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6e8b49a4-e57e-4d94-8428-da8bad21f000 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1505 microversion: 2.1 time: 0.235481 Feb 28 19:04:26.265939 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 162/324] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:26 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:26.424210 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-252863cb-de52-47f2-81a6-f693f22aa2f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:26.425172 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-252863cb-de52-47f2-81a6-f693f22aa2f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:26.433506 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-252863cb-de52-47f2-81a6-f693f22aa2f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:26.433954 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-252863cb-de52-47f2-81a6-f693f22aa2f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:26.434773 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-252863cb-de52-47f2-81a6-f693f22aa2f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:26.435242 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-252863cb-de52-47f2-81a6-f693f22aa2f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:26.498239 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-252863cb-de52-47f2-81a6-f693f22aa2f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078372 Feb 28 19:04:26.498810 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 163/325] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:26 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 19:04:26.544497 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e4e64a2c-1216-4714-9b0f-3c6119921478 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:26.545169 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e4e64a2c-1216-4714-9b0f-3c6119921478 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:26.552338 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e4e64a2c-1216-4714-9b0f-3c6119921478 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:26.552782 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e4e64a2c-1216-4714-9b0f-3c6119921478 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:26.553810 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e4e64a2c-1216-4714-9b0f-3c6119921478 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:26.554246 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e4e64a2c-1216-4714-9b0f-3c6119921478 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:26.701986 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1393526206", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "networks": [{"uuid": "449788a3-ff13-44f6-8b3b-66a4d81bb7d5"}]}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:26.777663 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] validate_networks() for [('449788a3-ff13-44f6-8b3b-66a4d81bb7d5', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:04:26.779752 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e4e64a2c-1216-4714-9b0f-3c6119921478 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:26.799892 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e4e64a2c-1216-4714-9b0f-3c6119921478 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.259008 Feb 28 19:04:26.810388 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 163/326] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:26 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:27.281908 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f2e00609-83f2-408c-ad8f-30f29bd404b1 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:27.283939 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f2e00609-83f2-408c-ad8f-30f29bd404b1 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:27.293678 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f2e00609-83f2-408c-ad8f-30f29bd404b1 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:27.294133 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f2e00609-83f2-408c-ad8f-30f29bd404b1 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:27.294919 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f2e00609-83f2-408c-ad8f-30f29bd404b1 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:27.295419 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f2e00609-83f2-408c-ad8f-30f29bd404b1 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:27.324354 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:04:27.325082 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:04:27.325547 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:04:27.331105 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:04:27.331105 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:04:27.336941 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:27.337385 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:27.338170 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:27.338755 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:27.363462 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Getting quotas for project 498eaf5c78e54296ac5cdeef3489e3ef. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:04:27.368329 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Getting quotas for user 46e767d2e3624a3fa799c8c1b20b0516 and project 498eaf5c78e54296ac5cdeef3489e3ef. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:04:27.379503 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:04:27.382178 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:04:27.524169 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f2e00609-83f2-408c-ad8f-30f29bd404b1 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:27.532508 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f2e00609-83f2-408c-ad8f-30f29bd404b1 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1505 microversion: 2.1 time: 0.254452 Feb 28 19:04:27.533066 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 164/327] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:27 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:27.561559 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-949017a7-8132-41a3-a3d7-400443164527 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864955 Feb 28 19:04:27.562299 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 164/328] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:04:27.572078 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cb6322d9-11e9-4c56-9a88-10cbc78583d9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:27.572688 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-cb6322d9-11e9-4c56-9a88-10cbc78583d9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:27.642281 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-cb6322d9-11e9-4c56-9a88-10cbc78583d9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:27.650324 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-cb6322d9-11e9-4c56-9a88-10cbc78583d9 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1218 microversion: 2.1 time: 0.081996 Feb 28 19:04:27.650891 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 165/329] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:27 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:27.817358 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-90660ffc-ab4b-40f0-a030-fd108ba32869 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:27.818065 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-90660ffc-ab4b-40f0-a030-fd108ba32869 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:27.826333 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-90660ffc-ab4b-40f0-a030-fd108ba32869 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:27.826787 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-90660ffc-ab4b-40f0-a030-fd108ba32869 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:27.827765 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-90660ffc-ab4b-40f0-a030-fd108ba32869 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:27.828021 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-90660ffc-ab4b-40f0-a030-fd108ba32869 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:27.842863 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-b29edec6-aeaf-4683-8827-02d7dd9f18dc req-ffd97228-1e6f-45a4-9d6c-f8a39b55fa8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af024eef-b2ab-4438-a2b8-74b5b4848624", "name": "network-vif-deleted", "tag": "d582ddb5-9e56-41f0-8777-0be57ac14caa"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:27.844843 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:04:27.844843 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:04:27.857411 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-b29edec6-aeaf-4683-8827-02d7dd9f18dc req-ffd97228-1e6f-45a4-9d6c-f8a39b55fa8a service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:27.857959 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-b29edec6-aeaf-4683-8827-02d7dd9f18dc req-ffd97228-1e6f-45a4-9d6c-f8a39b55fa8a service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:27.874512 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-b29edec6-aeaf-4683-8827-02d7dd9f18dc req-ffd97228-1e6f-45a4-9d6c-f8a39b55fa8a service nova] Creating event network-vif-deleted:d582ddb5-9e56-41f0-8777-0be57ac14caa for instance af024eef-b2ab-4438-a2b8-74b5b4848624 on hv-cinder-83118 Feb 28 19:04:27.879581 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-b29edec6-aeaf-4683-8827-02d7dd9f18dc req-ffd97228-1e6f-45a4-9d6c-f8a39b55fa8a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040473 Feb 28 19:04:27.880368 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 166/330] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:04:28.182673 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-90660ffc-ab4b-40f0-a030-fd108ba32869 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:28.191609 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-90660ffc-ab4b-40f0-a030-fd108ba32869 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.377878 Feb 28 19:04:28.192388 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 165/331] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:27 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:28.550262 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-fd78ad8f-a568-4800-b0a7-0e64d54aa5ab tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:28.550957 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-fd78ad8f-a568-4800-b0a7-0e64d54aa5ab tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:28.559316 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fd78ad8f-a568-4800-b0a7-0e64d54aa5ab tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:28.559763 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fd78ad8f-a568-4800-b0a7-0e64d54aa5ab tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:28.560551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fd78ad8f-a568-4800-b0a7-0e64d54aa5ab tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:28.560978 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fd78ad8f-a568-4800-b0a7-0e64d54aa5ab tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:28.629612 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fd78ad8f-a568-4800-b0a7-0e64d54aa5ab tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:28.630233 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fd78ad8f-a568-4800-b0a7-0e64d54aa5ab tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:28.630487 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-fd78ad8f-a568-4800-b0a7-0e64d54aa5ab tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lazy-loading 'fault' on Instance uuid af024eef-b2ab-4438-a2b8-74b5b4848624 {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:04:28.668298 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e18b1e35-ba84-4750-951b-20c058ab2122 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:28.669100 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e18b1e35-ba84-4750-951b-20c058ab2122 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:28.677972 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e18b1e35-ba84-4750-951b-20c058ab2122 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:28.679260 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e18b1e35-ba84-4750-951b-20c058ab2122 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:28.681508 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e18b1e35-ba84-4750-951b-20c058ab2122 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:28.682116 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e18b1e35-ba84-4750-951b-20c058ab2122 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:28.690129 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-fd78ad8f-a568-4800-b0a7-0e64d54aa5ab tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:28.699148 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-fd78ad8f-a568-4800-b0a7-0e64d54aa5ab tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 200 len: 1304 microversion: 2.1 time: 0.152837 Feb 28 19:04:28.699862 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 167/332] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:28 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:28.813932 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e18b1e35-ba84-4750-951b-20c058ab2122 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:28.822333 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e18b1e35-ba84-4750-951b-20c058ab2122 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1222 microversion: 2.1 time: 0.158571 Feb 28 19:04:28.822892 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 166/333] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:28 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:29.209296 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9bf71ee5-95ef-4591-9ebe-9a0a82c6a543 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:29.210855 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9bf71ee5-95ef-4591-9ebe-9a0a82c6a543 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:29.218680 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9bf71ee5-95ef-4591-9ebe-9a0a82c6a543 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:29.219275 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9bf71ee5-95ef-4591-9ebe-9a0a82c6a543 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:29.220108 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9bf71ee5-95ef-4591-9ebe-9a0a82c6a543 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:29.220624 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9bf71ee5-95ef-4591-9ebe-9a0a82c6a543 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:29.419828 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9bf71ee5-95ef-4591-9ebe-9a0a82c6a543 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:29.429405 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9bf71ee5-95ef-4591-9ebe-9a0a82c6a543 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.223783 Feb 28 19:04:29.429973 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 168/334] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:29 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:29.720701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a963ae65-30cb-4e0e-bf2b-4940a4046e2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:29.721256 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a963ae65-30cb-4e0e-bf2b-4940a4046e2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: af024eef-b2ab-4438-a2b8-74b5b4848624] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:29.729104 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a963ae65-30cb-4e0e-bf2b-4940a4046e2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:29.729555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a963ae65-30cb-4e0e-bf2b-4940a4046e2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:29.730354 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a963ae65-30cb-4e0e-bf2b-4940a4046e2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:29.730790 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a963ae65-30cb-4e0e-bf2b-4940a4046e2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:29.788781 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-a963ae65-30cb-4e0e-bf2b-4940a4046e2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] HTTP exception thrown: Instance af024eef-b2ab-4438-a2b8-74b5b4848624 could not be found. Feb 28 19:04:29.795739 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a963ae65-30cb-4e0e-bf2b-4940a4046e2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Returning 404 to user: Instance af024eef-b2ab-4438-a2b8-74b5b4848624 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:04:29.795739 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a963ae65-30cb-4e0e-bf2b-4940a4046e2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624" status: 404 len: 111 microversion: 2.1 time: 0.073314 Feb 28 19:04:29.795739 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 167/335] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:29 2022] GET /compute/v2.1/servers/af024eef-b2ab-4438-a2b8-74b5b4848624 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:04:29.839254 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-86e7ac16-5490-44bd-9958-8e4df520ce51 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:29.839825 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-86e7ac16-5490-44bd-9958-8e4df520ce51 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:29.848250 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-86e7ac16-5490-44bd-9958-8e4df520ce51 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:29.848693 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-86e7ac16-5490-44bd-9958-8e4df520ce51 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:29.849910 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-86e7ac16-5490-44bd-9958-8e4df520ce51 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:29.851013 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-86e7ac16-5490-44bd-9958-8e4df520ce51 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:29.922179 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1302041560", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "networks": [{"uuid": "77db8b85-5a3d-4493-8542-d665273d50c5"}]}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:29.995918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] validate_networks() for [('77db8b85-5a3d-4493-8542-d665273d50c5', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:04:30.006002 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-86e7ac16-5490-44bd-9958-8e4df520ce51 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:30.016627 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-86e7ac16-5490-44bd-9958-8e4df520ce51 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1270 microversion: 2.1 time: 0.181297 Feb 28 19:04:30.021891 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 169/336] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:29 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:30.445688 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-85c472a2-9ce0-4c0c-9c77-a1cbe841bda1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:30.453458 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-85c472a2-9ce0-4c0c-9c77-a1cbe841bda1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:30.453622 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85c472a2-9ce0-4c0c-9c77-a1cbe841bda1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:30.454080 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85c472a2-9ce0-4c0c-9c77-a1cbe841bda1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:30.454855 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85c472a2-9ce0-4c0c-9c77-a1cbe841bda1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:30.455318 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85c472a2-9ce0-4c0c-9c77-a1cbe841bda1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:30.613160 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:04:30.613874 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:04:30.614533 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:04:30.615088 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:04:30.615819 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:04:30.624942 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:30.625792 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:30.626811 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:30.627599 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:30.653739 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Getting quotas for project 1bdeeae6a56d4607962f8b0a1490547a. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:04:30.657687 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Getting quotas for user 3484bc7ebe7d4ddd972788b2ce5434ff and project 1bdeeae6a56d4607962f8b0a1490547a. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:04:30.668579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:04:30.670844 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:04:30.691676 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-85c472a2-9ce0-4c0c-9c77-a1cbe841bda1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:30.700888 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-85c472a2-9ce0-4c0c-9c77-a1cbe841bda1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.258950 Feb 28 19:04:30.701452 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 170/337] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:30 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:30.961566 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-366b34f6-5c25-4f36-a096-2d0b2d2fc2d7 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042764 Feb 28 19:04:30.968320 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 168/338] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:04:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 28 19:04:30.973123 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d64d5f87-9c00-4331-9faa-25730473fe25 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:30.973736 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d64d5f87-9c00-4331-9faa-25730473fe25 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:31.035881 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-df0af7f3-293f-4f0e-9962-5f209035b98b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:31.036964 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-df0af7f3-293f-4f0e-9962-5f209035b98b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:31.047919 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df0af7f3-293f-4f0e-9962-5f209035b98b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:31.048600 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df0af7f3-293f-4f0e-9962-5f209035b98b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:31.050563 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df0af7f3-293f-4f0e-9962-5f209035b98b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:31.051137 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df0af7f3-293f-4f0e-9962-5f209035b98b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:31.057932 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d64d5f87-9c00-4331-9faa-25730473fe25 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:31.066332 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d64d5f87-9c00-4331-9faa-25730473fe25 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1214 microversion: 2.1 time: 0.096890 Feb 28 19:04:31.067102 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 171/339] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:30 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:31.182901 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-df0af7f3-293f-4f0e-9962-5f209035b98b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:31.191747 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-df0af7f3-293f-4f0e-9962-5f209035b98b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1278 microversion: 2.1 time: 0.161576 Feb 28 19:04:31.192530 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 169/340] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:31 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:31.718653 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b4c98f0c-3a93-4d3c-a190-02a0e6fb386d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:31.719592 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b4c98f0c-3a93-4d3c-a190-02a0e6fb386d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:31.735516 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b4c98f0c-3a93-4d3c-a190-02a0e6fb386d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:31.736585 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b4c98f0c-3a93-4d3c-a190-02a0e6fb386d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:31.737591 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b4c98f0c-3a93-4d3c-a190-02a0e6fb386d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:31.738285 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b4c98f0c-3a93-4d3c-a190-02a0e6fb386d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:31.940596 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b4c98f0c-3a93-4d3c-a190-02a0e6fb386d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:31.953199 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b4c98f0c-3a93-4d3c-a190-02a0e6fb386d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.237606 Feb 28 19:04:31.953199 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 172/341] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:31 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:32.083892 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-46904e01-b405-4ee1-9a6c-b3dde7dbc595 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:32.084639 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-46904e01-b405-4ee1-9a6c-b3dde7dbc595 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:32.092020 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-46904e01-b405-4ee1-9a6c-b3dde7dbc595 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:32.092743 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-46904e01-b405-4ee1-9a6c-b3dde7dbc595 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:32.107398 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-46904e01-b405-4ee1-9a6c-b3dde7dbc595 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:32.107398 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-46904e01-b405-4ee1-9a6c-b3dde7dbc595 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:32.210202 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0a371e1b-5bfd-4385-8ea8-a604dd3b7f9a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:32.210907 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0a371e1b-5bfd-4385-8ea8-a604dd3b7f9a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:32.230437 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a371e1b-5bfd-4385-8ea8-a604dd3b7f9a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:32.230878 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a371e1b-5bfd-4385-8ea8-a604dd3b7f9a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:32.231688 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a371e1b-5bfd-4385-8ea8-a604dd3b7f9a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:32.232117 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a371e1b-5bfd-4385-8ea8-a604dd3b7f9a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:32.254986 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-46904e01-b405-4ee1-9a6c-b3dde7dbc595 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:32.264762 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-46904e01-b405-4ee1-9a6c-b3dde7dbc595 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1218 microversion: 2.1 time: 0.184434 Feb 28 19:04:32.265966 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 170/342] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:32 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:32.511928 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0a371e1b-5bfd-4385-8ea8-a604dd3b7f9a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:32.522480 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0a371e1b-5bfd-4385-8ea8-a604dd3b7f9a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.315940 Feb 28 19:04:32.531981 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 173/343] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:32 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:32.968593 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1b65d9c9-c08c-43fe-8ea5-d22be300e6ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:32.969200 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1b65d9c9-c08c-43fe-8ea5-d22be300e6ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:32.996540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1b65d9c9-c08c-43fe-8ea5-d22be300e6ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:32.998210 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1b65d9c9-c08c-43fe-8ea5-d22be300e6ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:33.003896 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1b65d9c9-c08c-43fe-8ea5-d22be300e6ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:33.004449 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1b65d9c9-c08c-43fe-8ea5-d22be300e6ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:33.293521 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-dfaa1fee-6859-4e04-a199-3538b78c794a tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:33.293521 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-dfaa1fee-6859-4e04-a199-3538b78c794a tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:33.302638 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dfaa1fee-6859-4e04-a199-3538b78c794a tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:33.303436 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dfaa1fee-6859-4e04-a199-3538b78c794a tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:33.304235 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dfaa1fee-6859-4e04-a199-3538b78c794a tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:33.305594 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dfaa1fee-6859-4e04-a199-3538b78c794a tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:33.442540 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-dfaa1fee-6859-4e04-a199-3538b78c794a tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:33.449515 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1b65d9c9-c08c-43fe-8ea5-d22be300e6ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:33.451592 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-dfaa1fee-6859-4e04-a199-3538b78c794a tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1210 microversion: 2.1 time: 0.173501 Feb 28 19:04:33.452379 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 174/344] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:33 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1210 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:33.456718 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-c2ed1e29-0e41-412e-b274-e2174af73bb8 req-216d2bcc-366b-4c0e-9d3c-3448a55cc2fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0056e80-82b0-4042-b106-de36581e773c", "tag": "8f626c26-4ced-4885-8f45-4bd5d5e7e95c"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:33.458467 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:04:33.458467 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:04:33.467431 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-c2ed1e29-0e41-412e-b274-e2174af73bb8 req-216d2bcc-366b-4c0e-9d3c-3448a55cc2fe service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:33.468025 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-c2ed1e29-0e41-412e-b274-e2174af73bb8 req-216d2bcc-366b-4c0e-9d3c-3448a55cc2fe service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:33.468803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1b65d9c9-c08c-43fe-8ea5-d22be300e6ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.503901 Feb 28 19:04:33.473637 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 171/345] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:32 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:33.486351 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-c2ed1e29-0e41-412e-b274-e2174af73bb8 req-216d2bcc-366b-4c0e-9d3c-3448a55cc2fe service nova] Creating event network-changed:8f626c26-4ced-4885-8f45-4bd5d5e7e95c for instance f0056e80-82b0-4042-b106-de36581e773c on hv-cinder-83118 Feb 28 19:04:33.491084 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-c2ed1e29-0e41-412e-b274-e2174af73bb8 req-216d2bcc-366b-4c0e-9d3c-3448a55cc2fe service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037825 Feb 28 19:04:33.498379 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 175/346] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:33.540566 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2a2430ce-9b69-4007-ac16-9e6ef7055611 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:33.541508 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2a2430ce-9b69-4007-ac16-9e6ef7055611 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:33.548947 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a2430ce-9b69-4007-ac16-9e6ef7055611 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:33.550014 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a2430ce-9b69-4007-ac16-9e6ef7055611 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:33.550256 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a2430ce-9b69-4007-ac16-9e6ef7055611 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:33.550723 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a2430ce-9b69-4007-ac16-9e6ef7055611 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:33.744261 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2a2430ce-9b69-4007-ac16-9e6ef7055611 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:33.752348 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2a2430ce-9b69-4007-ac16-9e6ef7055611 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.216699 Feb 28 19:04:33.752897 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 172/347] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:33 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:34.469724 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5281587d-0791-4067-a7cb-6c3d4e9ae551 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:34.470420 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5281587d-0791-4067-a7cb-6c3d4e9ae551 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:34.478928 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5281587d-0791-4067-a7cb-6c3d4e9ae551 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:34.479449 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5281587d-0791-4067-a7cb-6c3d4e9ae551 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:34.480258 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5281587d-0791-4067-a7cb-6c3d4e9ae551 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:34.480690 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5281587d-0791-4067-a7cb-6c3d4e9ae551 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:34.486251 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-77ee70b7-fb8b-4346-9a28-ee98fe433ece tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:34.486981 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-77ee70b7-fb8b-4346-9a28-ee98fe433ece tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:34.494999 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-77ee70b7-fb8b-4346-9a28-ee98fe433ece tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:34.495470 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-77ee70b7-fb8b-4346-9a28-ee98fe433ece tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:34.496232 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-77ee70b7-fb8b-4346-9a28-ee98fe433ece tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:34.496657 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-77ee70b7-fb8b-4346-9a28-ee98fe433ece tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:34.628209 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5281587d-0791-4067-a7cb-6c3d4e9ae551 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:34.636960 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5281587d-0791-4067-a7cb-6c3d4e9ae551 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1266 microversion: 2.1 time: 0.171344 Feb 28 19:04:34.637740 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 176/348] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:34 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:34.720860 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-77ee70b7-fb8b-4346-9a28-ee98fe433ece tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:34.724302 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-77ee70b7-fb8b-4346-9a28-ee98fe433ece tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.241653 Feb 28 19:04:34.724858 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 173/349] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:34 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:34.769412 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f7fbe01a-a568-4402-887f-d30681857ed2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:34.770020 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f7fbe01a-a568-4402-887f-d30681857ed2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:34.777896 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7fbe01a-a568-4402-887f-d30681857ed2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:34.778336 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7fbe01a-a568-4402-887f-d30681857ed2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:34.779090 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7fbe01a-a568-4402-887f-d30681857ed2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:34.779540 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f7fbe01a-a568-4402-887f-d30681857ed2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:35.032413 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f7fbe01a-a568-4402-887f-d30681857ed2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:35.041547 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f7fbe01a-a568-4402-887f-d30681857ed2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.275725 Feb 28 19:04:35.042113 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 177/350] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:34 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:35.654181 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-441a5645-873b-4978-bdad-b746deb1ac2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:35.654794 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-441a5645-873b-4978-bdad-b746deb1ac2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:35.662039 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-441a5645-873b-4978-bdad-b746deb1ac2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:35.662487 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-441a5645-873b-4978-bdad-b746deb1ac2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:35.663279 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-441a5645-873b-4978-bdad-b746deb1ac2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:35.664329 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-441a5645-873b-4978-bdad-b746deb1ac2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:35.741086 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0a852fdd-4f20-4adc-a015-a004c91eb063 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:35.742080 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0a852fdd-4f20-4adc-a015-a004c91eb063 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:35.749454 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a852fdd-4f20-4adc-a015-a004c91eb063 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:35.749893 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a852fdd-4f20-4adc-a015-a004c91eb063 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:35.750656 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a852fdd-4f20-4adc-a015-a004c91eb063 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:35.751085 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0a852fdd-4f20-4adc-a015-a004c91eb063 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:35.781523 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-441a5645-873b-4978-bdad-b746deb1ac2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:35.791129 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-441a5645-873b-4978-bdad-b746deb1ac2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1266 microversion: 2.1 time: 0.140627 Feb 28 19:04:35.791778 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 174/351] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:35 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:35.942094 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0a852fdd-4f20-4adc-a015-a004c91eb063 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:35.951405 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0a852fdd-4f20-4adc-a015-a004c91eb063 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.213991 Feb 28 19:04:35.951971 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 178/352] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:35 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:36.058304 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fc9f64a2-b916-4778-9b24-5e87b1ddca7b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:36.058917 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-fc9f64a2-b916-4778-9b24-5e87b1ddca7b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:36.066013 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc9f64a2-b916-4778-9b24-5e87b1ddca7b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:36.066461 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc9f64a2-b916-4778-9b24-5e87b1ddca7b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:36.067272 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc9f64a2-b916-4778-9b24-5e87b1ddca7b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:36.067699 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fc9f64a2-b916-4778-9b24-5e87b1ddca7b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:36.260686 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fc9f64a2-b916-4778-9b24-5e87b1ddca7b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:36.268613 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-fc9f64a2-b916-4778-9b24-5e87b1ddca7b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.214286 Feb 28 19:04:36.269173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 175/353] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:36 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:36.808821 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2b305e6f-59dd-4deb-b187-444c9f01261e tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:36.809450 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-2b305e6f-59dd-4deb-b187-444c9f01261e tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:36.816833 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2b305e6f-59dd-4deb-b187-444c9f01261e tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:36.817274 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2b305e6f-59dd-4deb-b187-444c9f01261e tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:36.818050 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2b305e6f-59dd-4deb-b187-444c9f01261e tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:36.818761 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2b305e6f-59dd-4deb-b187-444c9f01261e tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:36.930369 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-2b305e6f-59dd-4deb-b187-444c9f01261e tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:36.938571 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2b305e6f-59dd-4deb-b187-444c9f01261e tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1266 microversion: 2.1 time: 0.134110 Feb 28 19:04:36.939159 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 179/354] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:36 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:36.968598 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ae1b476b-912d-4f0a-bfaf-68d98faabaec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:36.969324 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ae1b476b-912d-4f0a-bfaf-68d98faabaec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:36.977623 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ae1b476b-912d-4f0a-bfaf-68d98faabaec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:36.978186 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ae1b476b-912d-4f0a-bfaf-68d98faabaec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:36.979035 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ae1b476b-912d-4f0a-bfaf-68d98faabaec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:36.979577 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ae1b476b-912d-4f0a-bfaf-68d98faabaec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:37.173767 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ae1b476b-912d-4f0a-bfaf-68d98faabaec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:37.182180 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ae1b476b-912d-4f0a-bfaf-68d98faabaec tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.217290 Feb 28 19:04:37.182733 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 176/355] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:36 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:37.285518 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a5cecae9-1e30-44f8-9a87-3666f9e9fad6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:37.286185 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a5cecae9-1e30-44f8-9a87-3666f9e9fad6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:37.294466 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5cecae9-1e30-44f8-9a87-3666f9e9fad6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:37.294993 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5cecae9-1e30-44f8-9a87-3666f9e9fad6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:37.295869 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5cecae9-1e30-44f8-9a87-3666f9e9fad6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:37.296404 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5cecae9-1e30-44f8-9a87-3666f9e9fad6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:37.487573 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a5cecae9-1e30-44f8-9a87-3666f9e9fad6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:37.495827 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a5cecae9-1e30-44f8-9a87-3666f9e9fad6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.214152 Feb 28 19:04:37.496382 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 180/356] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:37 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:37.955296 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-3a6d2fbc-e10a-4764-acd2-305c61498e7b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:37.955816 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3a6d2fbc-e10a-4764-acd2-305c61498e7b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:37.963591 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3a6d2fbc-e10a-4764-acd2-305c61498e7b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:37.964038 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3a6d2fbc-e10a-4764-acd2-305c61498e7b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:37.964830 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3a6d2fbc-e10a-4764-acd2-305c61498e7b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:37.965259 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3a6d2fbc-e10a-4764-acd2-305c61498e7b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:38.117690 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-3a6d2fbc-e10a-4764-acd2-305c61498e7b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:38.126184 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-3a6d2fbc-e10a-4764-acd2-305c61498e7b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1266 microversion: 2.1 time: 0.174868 Feb 28 19:04:38.127183 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 177/357] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:37 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:38.207485 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-72f81a62-ab3a-45ff-9eb7-a47af995c16f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:38.208046 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-72f81a62-ab3a-45ff-9eb7-a47af995c16f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:38.218302 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72f81a62-ab3a-45ff-9eb7-a47af995c16f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:38.218746 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72f81a62-ab3a-45ff-9eb7-a47af995c16f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:38.219567 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72f81a62-ab3a-45ff-9eb7-a47af995c16f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:38.221000 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-72f81a62-ab3a-45ff-9eb7-a47af995c16f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:38.512637 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f0ecc759-9afa-4716-a390-373a421c90dc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:38.513555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f0ecc759-9afa-4716-a390-373a421c90dc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:38.521532 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f0ecc759-9afa-4716-a390-373a421c90dc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:38.522056 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f0ecc759-9afa-4716-a390-373a421c90dc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:38.523728 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f0ecc759-9afa-4716-a390-373a421c90dc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:38.524405 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f0ecc759-9afa-4716-a390-373a421c90dc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:38.607426 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-72f81a62-ab3a-45ff-9eb7-a47af995c16f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:38.617059 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-72f81a62-ab3a-45ff-9eb7-a47af995c16f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.420511 Feb 28 19:04:38.617710 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 181/358] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:38 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:38.929638 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f0ecc759-9afa-4716-a390-373a421c90dc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:38.934788 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f0ecc759-9afa-4716-a390-373a421c90dc tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.425846 Feb 28 19:04:38.946302 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 178/359] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:38 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:39.143561 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cf096c8f-04ba-4d7d-ad65-a5f121780cb5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:39.144258 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-cf096c8f-04ba-4d7d-ad65-a5f121780cb5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:39.153094 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cf096c8f-04ba-4d7d-ad65-a5f121780cb5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:39.153542 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cf096c8f-04ba-4d7d-ad65-a5f121780cb5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:39.154313 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cf096c8f-04ba-4d7d-ad65-a5f121780cb5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:39.154749 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cf096c8f-04ba-4d7d-ad65-a5f121780cb5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:39.267362 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-cf096c8f-04ba-4d7d-ad65-a5f121780cb5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:39.275593 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-cf096c8f-04ba-4d7d-ad65-a5f121780cb5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1272 microversion: 2.1 time: 0.135815 Feb 28 19:04:39.276149 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 182/360] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:39 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:39.633122 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d1533024-1106-4969-aee7-83278acf0761 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:39.633895 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d1533024-1106-4969-aee7-83278acf0761 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:39.641313 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d1533024-1106-4969-aee7-83278acf0761 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:39.641758 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d1533024-1106-4969-aee7-83278acf0761 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:39.642521 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d1533024-1106-4969-aee7-83278acf0761 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:39.642959 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d1533024-1106-4969-aee7-83278acf0761 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:39.843801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d1533024-1106-4969-aee7-83278acf0761 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:39.853024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d1533024-1106-4969-aee7-83278acf0761 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.223799 Feb 28 19:04:39.853588 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 179/361] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:39 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:39.951454 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-afd4c986-a097-4106-a0fe-5139ab76d2d8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:39.952270 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-afd4c986-a097-4106-a0fe-5139ab76d2d8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:39.960188 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-afd4c986-a097-4106-a0fe-5139ab76d2d8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:39.960819 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-afd4c986-a097-4106-a0fe-5139ab76d2d8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:39.962256 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-afd4c986-a097-4106-a0fe-5139ab76d2d8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:39.962841 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-afd4c986-a097-4106-a0fe-5139ab76d2d8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:40.162901 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-afd4c986-a097-4106-a0fe-5139ab76d2d8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:40.172068 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-afd4c986-a097-4106-a0fe-5139ab76d2d8 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.224587 Feb 28 19:04:40.172630 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 183/362] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:39 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:40.293179 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-98f689bd-4376-437d-832c-f60dd94a1899 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:40.293804 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-98f689bd-4376-437d-832c-f60dd94a1899 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:40.300962 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-98f689bd-4376-437d-832c-f60dd94a1899 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:40.301410 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-98f689bd-4376-437d-832c-f60dd94a1899 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:40.302179 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-98f689bd-4376-437d-832c-f60dd94a1899 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:40.302613 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-98f689bd-4376-437d-832c-f60dd94a1899 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:40.501302 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-98f689bd-4376-437d-832c-f60dd94a1899 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:40.509772 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-98f689bd-4376-437d-832c-f60dd94a1899 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.221358 Feb 28 19:04:40.510339 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 180/363] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:40 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:40.693831 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-fb67974f-a00d-47ca-a606-9570c30c0b05 req-4348b34b-5363-458a-96c4-55dab93e9b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d1e8b4d-5b60-4aa8-a2a6-312d9082e219", "tag": "803d189d-eff4-4043-8232-89811430f5a5"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:40.695981 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:04:40.695981 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:04:40.709406 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-fb67974f-a00d-47ca-a606-9570c30c0b05 req-4348b34b-5363-458a-96c4-55dab93e9b1c service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:40.709406 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-fb67974f-a00d-47ca-a606-9570c30c0b05 req-4348b34b-5363-458a-96c4-55dab93e9b1c service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:40.721889 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-fb67974f-a00d-47ca-a606-9570c30c0b05 req-4348b34b-5363-458a-96c4-55dab93e9b1c service nova] Creating event network-changed:803d189d-eff4-4043-8232-89811430f5a5 for instance 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 on hv-cinder-83118 Feb 28 19:04:40.726388 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-fb67974f-a00d-47ca-a606-9570c30c0b05 req-4348b34b-5363-458a-96c4-55dab93e9b1c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036123 Feb 28 19:04:40.726974 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 184/364] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:40.870587 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e7e4bf8c-c9a4-4aa5-bf31-1ab8ae81d2ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:40.871296 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e7e4bf8c-c9a4-4aa5-bf31-1ab8ae81d2ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:40.878517 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7e4bf8c-c9a4-4aa5-bf31-1ab8ae81d2ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:40.879037 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7e4bf8c-c9a4-4aa5-bf31-1ab8ae81d2ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:40.879845 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7e4bf8c-c9a4-4aa5-bf31-1ab8ae81d2ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:40.880281 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7e4bf8c-c9a4-4aa5-bf31-1ab8ae81d2ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:41.095791 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e7e4bf8c-c9a4-4aa5-bf31-1ab8ae81d2ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:41.105442 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e7e4bf8c-c9a4-4aa5-bf31-1ab8ae81d2ef tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.239249 Feb 28 19:04:41.106018 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 181/365] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:40 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:41.189434 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9a73c0b7-b002-4743-b94a-4d18d58f6ebd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:41.190413 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9a73c0b7-b002-4743-b94a-4d18d58f6ebd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:41.200394 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9a73c0b7-b002-4743-b94a-4d18d58f6ebd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:41.201208 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9a73c0b7-b002-4743-b94a-4d18d58f6ebd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:41.202672 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9a73c0b7-b002-4743-b94a-4d18d58f6ebd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:41.203383 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9a73c0b7-b002-4743-b94a-4d18d58f6ebd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:41.418923 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9a73c0b7-b002-4743-b94a-4d18d58f6ebd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:41.426877 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9a73c0b7-b002-4743-b94a-4d18d58f6ebd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.241486 Feb 28 19:04:41.427459 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 185/366] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:41 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:41.526622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-944736bc-89e3-46ec-acb9-22b4c41ee1f5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:41.527171 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-944736bc-89e3-46ec-acb9-22b4c41ee1f5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:41.534314 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-944736bc-89e3-46ec-acb9-22b4c41ee1f5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:41.534756 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-944736bc-89e3-46ec-acb9-22b4c41ee1f5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:41.535554 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-944736bc-89e3-46ec-acb9-22b4c41ee1f5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:41.535981 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-944736bc-89e3-46ec-acb9-22b4c41ee1f5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:41.735589 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-944736bc-89e3-46ec-acb9-22b4c41ee1f5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:41.744332 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-944736bc-89e3-46ec-acb9-22b4c41ee1f5 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.220806 Feb 28 19:04:41.744903 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 182/367] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:41 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:42.122823 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-df66d966-47e9-4177-a9cf-8b860ae6c4b3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:42.123449 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-df66d966-47e9-4177-a9cf-8b860ae6c4b3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:42.130838 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-df66d966-47e9-4177-a9cf-8b860ae6c4b3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:42.131312 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-df66d966-47e9-4177-a9cf-8b860ae6c4b3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:42.132141 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-df66d966-47e9-4177-a9cf-8b860ae6c4b3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:42.132569 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-df66d966-47e9-4177-a9cf-8b860ae6c4b3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:42.329846 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-df66d966-47e9-4177-a9cf-8b860ae6c4b3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:42.343748 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-df66d966-47e9-4177-a9cf-8b860ae6c4b3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.225356 Feb 28 19:04:42.344315 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 186/368] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:42 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:42.446087 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-53b55d86-f07f-4bab-b624-d9012f909b3f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:42.447064 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-53b55d86-f07f-4bab-b624-d9012f909b3f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:42.454795 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-53b55d86-f07f-4bab-b624-d9012f909b3f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:42.456880 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-53b55d86-f07f-4bab-b624-d9012f909b3f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:42.456880 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-53b55d86-f07f-4bab-b624-d9012f909b3f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:42.456880 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-53b55d86-f07f-4bab-b624-d9012f909b3f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:42.723136 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-53b55d86-f07f-4bab-b624-d9012f909b3f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:42.732158 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-53b55d86-f07f-4bab-b624-d9012f909b3f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.290274 Feb 28 19:04:42.732720 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 183/369] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:42 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:42.761617 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-56524743-2d21-438c-97db-188437dabae0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:42.762219 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-56524743-2d21-438c-97db-188437dabae0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:42.769473 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56524743-2d21-438c-97db-188437dabae0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:42.769913 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56524743-2d21-438c-97db-188437dabae0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:42.770669 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56524743-2d21-438c-97db-188437dabae0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:42.771093 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56524743-2d21-438c-97db-188437dabae0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:42.972379 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-56524743-2d21-438c-97db-188437dabae0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:42.980612 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-56524743-2d21-438c-97db-188437dabae0 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.223269 Feb 28 19:04:42.981175 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 187/370] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:42 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:43.361237 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-aa118d19-7cb5-4643-955d-f0d742946e1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:43.361842 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-aa118d19-7cb5-4643-955d-f0d742946e1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:43.369979 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aa118d19-7cb5-4643-955d-f0d742946e1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:43.370458 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aa118d19-7cb5-4643-955d-f0d742946e1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:43.371313 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aa118d19-7cb5-4643-955d-f0d742946e1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:43.371757 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aa118d19-7cb5-4643-955d-f0d742946e1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:43.569405 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-aa118d19-7cb5-4643-955d-f0d742946e1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:43.578014 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-aa118d19-7cb5-4643-955d-f0d742946e1f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1565 microversion: 2.1 time: 0.220343 Feb 28 19:04:43.578572 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 184/371] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:43 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:43.749239 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4fbf7983-d5a7-4e80-a87d-5fc4bbc0ed87 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:43.749839 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4fbf7983-d5a7-4e80-a87d-5fc4bbc0ed87 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:43.758147 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4fbf7983-d5a7-4e80-a87d-5fc4bbc0ed87 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:43.758147 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4fbf7983-d5a7-4e80-a87d-5fc4bbc0ed87 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:43.758732 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4fbf7983-d5a7-4e80-a87d-5fc4bbc0ed87 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:43.759183 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4fbf7983-d5a7-4e80-a87d-5fc4bbc0ed87 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:43.960295 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4fbf7983-d5a7-4e80-a87d-5fc4bbc0ed87 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:43.969830 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4fbf7983-d5a7-4e80-a87d-5fc4bbc0ed87 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.224187 Feb 28 19:04:43.970572 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 188/372] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:43 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:43.997859 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cea491be-bbe2-4d4a-b343-1f59253ef8bc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:44.001872 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-cea491be-bbe2-4d4a-b343-1f59253ef8bc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:44.005967 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cea491be-bbe2-4d4a-b343-1f59253ef8bc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:44.006417 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cea491be-bbe2-4d4a-b343-1f59253ef8bc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:44.007213 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cea491be-bbe2-4d4a-b343-1f59253ef8bc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:44.007653 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cea491be-bbe2-4d4a-b343-1f59253ef8bc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:44.208321 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cea491be-bbe2-4d4a-b343-1f59253ef8bc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:44.217564 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-cea491be-bbe2-4d4a-b343-1f59253ef8bc tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.223498 Feb 28 19:04:44.218154 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 185/373] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:43 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:44.594800 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-66c5cc83-f6b6-447f-ba08-4ac344ac4d32 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:44.595435 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-66c5cc83-f6b6-447f-ba08-4ac344ac4d32 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:44.603014 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-66c5cc83-f6b6-447f-ba08-4ac344ac4d32 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:44.603526 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-66c5cc83-f6b6-447f-ba08-4ac344ac4d32 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:44.604273 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-66c5cc83-f6b6-447f-ba08-4ac344ac4d32 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:44.604704 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-66c5cc83-f6b6-447f-ba08-4ac344ac4d32 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:44.833602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-66c5cc83-f6b6-447f-ba08-4ac344ac4d32 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:44.842421 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-66c5cc83-f6b6-447f-ba08-4ac344ac4d32 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1545 microversion: 2.1 time: 0.251196 Feb 28 19:04:44.843915 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 189/374] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:44 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1545 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:44.858907 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d714d5b8-45c1-4139-95d4-4840791c6300 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:44.859447 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d714d5b8-45c1-4139-95d4-4840791c6300 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:44.866563 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d714d5b8-45c1-4139-95d4-4840791c6300 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:44.867006 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d714d5b8-45c1-4139-95d4-4840791c6300 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:44.867811 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d714d5b8-45c1-4139-95d4-4840791c6300 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:44.868242 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d714d5b8-45c1-4139-95d4-4840791c6300 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:44.987378 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2a458647-815f-461b-8e3b-ecc7b1b26293 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:44.988095 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-2a458647-815f-461b-8e3b-ecc7b1b26293 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:44.996073 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a458647-815f-461b-8e3b-ecc7b1b26293 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:45.003676 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a458647-815f-461b-8e3b-ecc7b1b26293 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:45.003676 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a458647-815f-461b-8e3b-ecc7b1b26293 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:45.003676 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a458647-815f-461b-8e3b-ecc7b1b26293 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:45.036232 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-d714d5b8-45c1-4139-95d4-4840791c6300 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] HTTP exception thrown: Cannot 'detach_volume' instance 26980bce-633e-4e70-9ebd-c1a38fb5cc4a while it is in vm_state rescued Feb 28 19:04:45.036841 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d714d5b8-45c1-4139-95d4-4840791c6300 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Returning 409 to user: Cannot 'detach_volume' instance 26980bce-633e-4e70-9ebd-c1a38fb5cc4a while it is in vm_state rescued {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:04:45.037666 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d714d5b8-45c1-4139-95d4-4840791c6300 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments/06a21a6b-aeb0-4fdc-ac3c-09daece69a70" status: 409 len: 152 microversion: 2.1 time: 0.182616 Feb 28 19:04:45.042116 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 186/375] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:04:44 2022] DELETE /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments/06a21a6b-aeb0-4fdc-ac3c-09daece69a70 => generated 152 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 28 19:04:45.047004 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-62dd65bf-c7d8-43ec-8034-1320e2216ab5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:45.047582 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-62dd65bf-c7d8-43ec-8034-1320e2216ab5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:45.055400 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-62dd65bf-c7d8-43ec-8034-1320e2216ab5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:45.055905 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-62dd65bf-c7d8-43ec-8034-1320e2216ab5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:45.057264 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-62dd65bf-c7d8-43ec-8034-1320e2216ab5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:45.057699 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-62dd65bf-c7d8-43ec-8034-1320e2216ab5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:45.229779 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-2a458647-815f-461b-8e3b-ecc7b1b26293 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:45.238722 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2a458647-815f-461b-8e3b-ecc7b1b26293 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.254991 Feb 28 19:04:45.239311 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 190/376] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:44 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:45.243782 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d3ef741d-0d1f-445c-84bc-d8bf639d6aee tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:45.244378 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d3ef741d-0d1f-445c-84bc-d8bf639d6aee tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:45.251137 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3ef741d-0d1f-445c-84bc-d8bf639d6aee tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:45.251664 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3ef741d-0d1f-445c-84bc-d8bf639d6aee tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:45.252394 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3ef741d-0d1f-445c-84bc-d8bf639d6aee tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:45.252823 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3ef741d-0d1f-445c-84bc-d8bf639d6aee tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:45.418959 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-62dd65bf-c7d8-43ec-8034-1320e2216ab5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/action" status: 202 len: 0 microversion: 2.1 time: 0.374883 Feb 28 19:04:45.423835 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 187/377] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:04:45 2022] POST /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:04:45.428606 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8a5ab4cb-5728-48e8-b7b3-8b221894c9bc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:45.429431 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8a5ab4cb-5728-48e8-b7b3-8b221894c9bc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:45.437983 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8a5ab4cb-5728-48e8-b7b3-8b221894c9bc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:45.438428 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8a5ab4cb-5728-48e8-b7b3-8b221894c9bc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:45.439229 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8a5ab4cb-5728-48e8-b7b3-8b221894c9bc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:45.439662 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8a5ab4cb-5728-48e8-b7b3-8b221894c9bc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:45.454735 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d3ef741d-0d1f-445c-84bc-d8bf639d6aee tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:45.464252 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d3ef741d-0d1f-445c-84bc-d8bf639d6aee tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.223938 Feb 28 19:04:45.469542 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 191/378] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:45 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:45.643859 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8a5ab4cb-5728-48e8-b7b3-8b221894c9bc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:45.653945 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8a5ab4cb-5728-48e8-b7b3-8b221894c9bc tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1553 microversion: 2.1 time: 0.229593 Feb 28 19:04:45.654515 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 188/379] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:45 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:46.258531 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1b49e94e-ef58-42aa-8fe2-daac0050b488 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:46.260026 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1b49e94e-ef58-42aa-8fe2-daac0050b488 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:46.267549 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1b49e94e-ef58-42aa-8fe2-daac0050b488 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:46.268066 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1b49e94e-ef58-42aa-8fe2-daac0050b488 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:46.269068 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1b49e94e-ef58-42aa-8fe2-daac0050b488 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:46.269575 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1b49e94e-ef58-42aa-8fe2-daac0050b488 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:46.465402 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1b49e94e-ef58-42aa-8fe2-daac0050b488 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:46.473673 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1b49e94e-ef58-42aa-8fe2-daac0050b488 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.219522 Feb 28 19:04:46.474419 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 192/380] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:46 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:46.495456 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-757749db-cd92-4cb5-97e1-32e3ce4cb4f4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:46.496102 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-757749db-cd92-4cb5-97e1-32e3ce4cb4f4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:46.503813 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-757749db-cd92-4cb5-97e1-32e3ce4cb4f4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:46.504405 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-757749db-cd92-4cb5-97e1-32e3ce4cb4f4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:46.505944 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-757749db-cd92-4cb5-97e1-32e3ce4cb4f4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:46.506701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-757749db-cd92-4cb5-97e1-32e3ce4cb4f4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:46.672162 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8b7da949-51ef-4311-9f1b-76f434e82211 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:46.672903 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8b7da949-51ef-4311-9f1b-76f434e82211 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:46.680316 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b7da949-51ef-4311-9f1b-76f434e82211 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:46.680896 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b7da949-51ef-4311-9f1b-76f434e82211 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:46.681777 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b7da949-51ef-4311-9f1b-76f434e82211 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:46.682283 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b7da949-51ef-4311-9f1b-76f434e82211 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:46.704547 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-757749db-cd92-4cb5-97e1-32e3ce4cb4f4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:46.713497 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-757749db-cd92-4cb5-97e1-32e3ce4cb4f4 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.232288 Feb 28 19:04:46.713990 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 189/381] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:46 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:46.882717 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8b7da949-51ef-4311-9f1b-76f434e82211 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:46.891529 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8b7da949-51ef-4311-9f1b-76f434e82211 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1553 microversion: 2.1 time: 0.222978 Feb 28 19:04:46.892161 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 193/382] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:46 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:47.494585 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cea01d4c-9daf-408a-8030-2887df132ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:47.495463 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-cea01d4c-9daf-408a-8030-2887df132ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:47.506312 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cea01d4c-9daf-408a-8030-2887df132ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:47.506925 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cea01d4c-9daf-408a-8030-2887df132ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:47.507780 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cea01d4c-9daf-408a-8030-2887df132ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:47.508307 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cea01d4c-9daf-408a-8030-2887df132ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:47.702017 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cea01d4c-9daf-408a-8030-2887df132ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:47.710155 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-cea01d4c-9daf-408a-8030-2887df132ae1 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.220463 Feb 28 19:04:47.710719 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 190/383] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:47 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:47.729781 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-adb8af74-bd62-4e2d-9ded-87b02ddf76f8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:47.730634 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-adb8af74-bd62-4e2d-9ded-87b02ddf76f8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:47.738176 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-adb8af74-bd62-4e2d-9ded-87b02ddf76f8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:47.738620 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-adb8af74-bd62-4e2d-9ded-87b02ddf76f8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:47.739410 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-adb8af74-bd62-4e2d-9ded-87b02ddf76f8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:47.739839 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-adb8af74-bd62-4e2d-9ded-87b02ddf76f8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:47.909822 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-48046a01-274a-4aea-9000-0cc5621be295 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:47.910563 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-48046a01-274a-4aea-9000-0cc5621be295 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:47.926095 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48046a01-274a-4aea-9000-0cc5621be295 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:47.926904 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48046a01-274a-4aea-9000-0cc5621be295 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:47.927953 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48046a01-274a-4aea-9000-0cc5621be295 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:47.928605 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48046a01-274a-4aea-9000-0cc5621be295 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:47.964290 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-adb8af74-bd62-4e2d-9ded-87b02ddf76f8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:47.976084 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-adb8af74-bd62-4e2d-9ded-87b02ddf76f8 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.250222 Feb 28 19:04:47.988076 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 194/384] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:47 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:48.158006 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-48046a01-274a-4aea-9000-0cc5621be295 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:48.168098 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-48046a01-274a-4aea-9000-0cc5621be295 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1553 microversion: 2.1 time: 0.261687 Feb 28 19:04:48.168586 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 191/385] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:47 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:48.412015 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-f25931a5-4f03-4486-a8c8-6b6ffdb27c2b req-0baab0fa-9083-4ec1-88c4-a19feb8c5d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0056e80-82b0-4042-b106-de36581e773c", "name": "network-vif-plugged", "status": "completed", "tag": "8f626c26-4ced-4885-8f45-4bd5d5e7e95c"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:48.413723 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:04:48.413723 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:04:48.424902 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-f25931a5-4f03-4486-a8c8-6b6ffdb27c2b req-0baab0fa-9083-4ec1-88c4-a19feb8c5d42 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:48.427469 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-f25931a5-4f03-4486-a8c8-6b6ffdb27c2b req-0baab0fa-9083-4ec1-88c4-a19feb8c5d42 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:48.443027 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-f25931a5-4f03-4486-a8c8-6b6ffdb27c2b req-0baab0fa-9083-4ec1-88c4-a19feb8c5d42 service nova] Creating event network-vif-plugged:8f626c26-4ced-4885-8f45-4bd5d5e7e95c for instance f0056e80-82b0-4042-b106-de36581e773c on hv-cinder-83118 Feb 28 19:04:48.448753 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-f25931a5-4f03-4486-a8c8-6b6ffdb27c2b req-0baab0fa-9083-4ec1-88c4-a19feb8c5d42 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040426 Feb 28 19:04:48.449336 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 195/386] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:48.726069 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-18f6d28e-6778-4bf0-a70b-bbcbe3b91897 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:48.726680 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-18f6d28e-6778-4bf0-a70b-bbcbe3b91897 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:48.733848 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18f6d28e-6778-4bf0-a70b-bbcbe3b91897 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:48.734289 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18f6d28e-6778-4bf0-a70b-bbcbe3b91897 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:48.735048 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18f6d28e-6778-4bf0-a70b-bbcbe3b91897 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:48.735501 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18f6d28e-6778-4bf0-a70b-bbcbe3b91897 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:48.951500 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-18f6d28e-6778-4bf0-a70b-bbcbe3b91897 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:48.963569 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-18f6d28e-6778-4bf0-a70b-bbcbe3b91897 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.241101 Feb 28 19:04:48.964143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 192/387] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:48 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:48.997538 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-caeb181f-3e2d-49f1-a5a5-24edf7e82a43 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:48.998503 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-caeb181f-3e2d-49f1-a5a5-24edf7e82a43 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:49.008604 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-caeb181f-3e2d-49f1-a5a5-24edf7e82a43 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:49.009753 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-caeb181f-3e2d-49f1-a5a5-24edf7e82a43 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:49.010627 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-caeb181f-3e2d-49f1-a5a5-24edf7e82a43 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:49.011179 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-caeb181f-3e2d-49f1-a5a5-24edf7e82a43 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:49.185990 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9505340c-548e-4e3d-a334-9c73ad5de1a3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:49.186776 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9505340c-548e-4e3d-a334-9c73ad5de1a3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:49.194969 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9505340c-548e-4e3d-a334-9c73ad5de1a3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:49.195589 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9505340c-548e-4e3d-a334-9c73ad5de1a3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:49.197242 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9505340c-548e-4e3d-a334-9c73ad5de1a3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:49.197741 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9505340c-548e-4e3d-a334-9c73ad5de1a3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:49.320724 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-caeb181f-3e2d-49f1-a5a5-24edf7e82a43 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:49.329118 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-caeb181f-3e2d-49f1-a5a5-24edf7e82a43 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.337694 Feb 28 19:04:49.329689 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 196/388] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:48 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:49.403701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9505340c-548e-4e3d-a334-9c73ad5de1a3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:49.412324 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9505340c-548e-4e3d-a334-9c73ad5de1a3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1553 microversion: 2.1 time: 0.230323 Feb 28 19:04:49.412888 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 193/389] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:49 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:49.980380 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-fa992e93-b2da-42b5-8079-18a0919d29e4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:49.982248 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-fa992e93-b2da-42b5-8079-18a0919d29e4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:49.989149 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fa992e93-b2da-42b5-8079-18a0919d29e4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:49.989596 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fa992e93-b2da-42b5-8079-18a0919d29e4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:49.990355 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fa992e93-b2da-42b5-8079-18a0919d29e4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:49.990778 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fa992e93-b2da-42b5-8079-18a0919d29e4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:50.185336 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-fa992e93-b2da-42b5-8079-18a0919d29e4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:50.193298 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-fa992e93-b2da-42b5-8079-18a0919d29e4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1318 microversion: 2.1 time: 0.216780 Feb 28 19:04:50.193847 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 197/390] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:49 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:50.345865 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-27633177-9f80-49e0-a7a5-46b8c54d8f3d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:50.346467 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-27633177-9f80-49e0-a7a5-46b8c54d8f3d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:50.353816 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-27633177-9f80-49e0-a7a5-46b8c54d8f3d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:50.354253 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-27633177-9f80-49e0-a7a5-46b8c54d8f3d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:50.355008 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-27633177-9f80-49e0-a7a5-46b8c54d8f3d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:50.355466 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-27633177-9f80-49e0-a7a5-46b8c54d8f3d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:50.429382 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ebc04074-e7e2-401d-8177-d6ea6e5d4212 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:50.429988 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ebc04074-e7e2-401d-8177-d6ea6e5d4212 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:50.438209 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebc04074-e7e2-401d-8177-d6ea6e5d4212 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:50.438655 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebc04074-e7e2-401d-8177-d6ea6e5d4212 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:50.439455 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebc04074-e7e2-401d-8177-d6ea6e5d4212 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:50.439889 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebc04074-e7e2-401d-8177-d6ea6e5d4212 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:50.594041 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-27633177-9f80-49e0-a7a5-46b8c54d8f3d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:50.602100 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-27633177-9f80-49e0-a7a5-46b8c54d8f3d tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.259905 Feb 28 19:04:50.602749 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 194/391] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:50 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:50.664537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ebc04074-e7e2-401d-8177-d6ea6e5d4212 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:50.673592 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ebc04074-e7e2-401d-8177-d6ea6e5d4212 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1559 microversion: 2.1 time: 0.247778 Feb 28 19:04:50.674149 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 198/392] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:50 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1559 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:50.771598 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b41e8416-ae57-47fc-ac7f-125ed4387c4b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:50.772097 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b41e8416-ae57-47fc-ac7f-125ed4387c4b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:50.779409 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b41e8416-ae57-47fc-ac7f-125ed4387c4b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:50.779855 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b41e8416-ae57-47fc-ac7f-125ed4387c4b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:50.780616 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b41e8416-ae57-47fc-ac7f-125ed4387c4b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:50.781048 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b41e8416-ae57-47fc-ac7f-125ed4387c4b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:50.941107 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-b41e8416-ae57-47fc-ac7f-125ed4387c4b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lazy-loading 'services' on Instance uuid 26980bce-633e-4e70-9ebd-c1a38fb5cc4a {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:04:51.210003 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-85db614d-f944-470a-b531-821d913dfa0e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:51.210548 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-85db614d-f944-470a-b531-821d913dfa0e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:51.218336 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85db614d-f944-470a-b531-821d913dfa0e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:51.218781 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85db614d-f944-470a-b531-821d913dfa0e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:51.219578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85db614d-f944-470a-b531-821d913dfa0e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:51.220010 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-85db614d-f944-470a-b531-821d913dfa0e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:51.382566 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b41e8416-ae57-47fc-ac7f-125ed4387c4b tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments/06a21a6b-aeb0-4fdc-ac3c-09daece69a70" status: 202 len: 0 microversion: 2.1 time: 0.614270 Feb 28 19:04:51.383180 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 195/393] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:04:50 2022] DELETE /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments/06a21a6b-aeb0-4fdc-ac3c-09daece69a70 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:04:51.393085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2a5e398c-a737-4bc3-b688-e1455d403157 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:51.394341 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2a5e398c-a737-4bc3-b688-e1455d403157 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:51.402839 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a5e398c-a737-4bc3-b688-e1455d403157 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:51.403557 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a5e398c-a737-4bc3-b688-e1455d403157 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:51.404579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a5e398c-a737-4bc3-b688-e1455d403157 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:51.405088 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a5e398c-a737-4bc3-b688-e1455d403157 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:51.418795 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-85db614d-f944-470a-b531-821d913dfa0e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:51.430062 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-85db614d-f944-470a-b531-821d913dfa0e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1507 microversion: 2.1 time: 0.220915 Feb 28 19:04:51.430062 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 199/394] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:51 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:51.472845 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2a5e398c-a737-4bc3-b688-e1455d403157 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084182 Feb 28 19:04:51.473576 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 196/395] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:51 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:04:51.619321 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9ecf62e6-8de5-4c83-83c0-7139748d7b2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:51.619937 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9ecf62e6-8de5-4c83-83c0-7139748d7b2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:51.627440 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ecf62e6-8de5-4c83-83c0-7139748d7b2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:51.627895 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ecf62e6-8de5-4c83-83c0-7139748d7b2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:51.628760 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ecf62e6-8de5-4c83-83c0-7139748d7b2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:51.629115 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ecf62e6-8de5-4c83-83c0-7139748d7b2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:51.829736 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9ecf62e6-8de5-4c83-83c0-7139748d7b2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:51.838578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9ecf62e6-8de5-4c83-83c0-7139748d7b2c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.223334 Feb 28 19:04:51.839165 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 200/396] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:51 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:52.277382 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-edccd631-ab93-4d5d-9bec-8124f183d55c req-0a97d37e-ef92-4128-be5c-8baab41c852e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1e8b4d-5b60-4aa8-a2a6-312d9082e219", "name": "network-vif-plugged", "status": "completed", "tag": "803d189d-eff4-4043-8232-89811430f5a5"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:52.279143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:04:52.279143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:04:52.288446 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-edccd631-ab93-4d5d-9bec-8124f183d55c req-0a97d37e-ef92-4128-be5c-8baab41c852e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:52.289388 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-edccd631-ab93-4d5d-9bec-8124f183d55c req-0a97d37e-ef92-4128-be5c-8baab41c852e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:52.309449 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-edccd631-ab93-4d5d-9bec-8124f183d55c req-0a97d37e-ef92-4128-be5c-8baab41c852e service nova] Creating event network-vif-plugged:803d189d-eff4-4043-8232-89811430f5a5 for instance 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 on hv-cinder-83118 Feb 28 19:04:52.314158 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-edccd631-ab93-4d5d-9bec-8124f183d55c req-0a97d37e-ef92-4128-be5c-8baab41c852e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042972 Feb 28 19:04:52.315085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 197/397] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:52.484482 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9186ae30-efab-4682-a570-49beaa8aa0b7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:52.485460 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9186ae30-efab-4682-a570-49beaa8aa0b7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:52.493569 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9186ae30-efab-4682-a570-49beaa8aa0b7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:52.494031 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9186ae30-efab-4682-a570-49beaa8aa0b7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:52.500621 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9186ae30-efab-4682-a570-49beaa8aa0b7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:52.500621 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9186ae30-efab-4682-a570-49beaa8aa0b7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:52.561344 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9186ae30-efab-4682-a570-49beaa8aa0b7 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080639 Feb 28 19:04:52.561894 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 201/398] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:52 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:52.855768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0a5bc4af-6a8c-44a1-a93b-883f3baf501f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:52.856469 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0a5bc4af-6a8c-44a1-a93b-883f3baf501f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:52.864006 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0a5bc4af-6a8c-44a1-a93b-883f3baf501f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:52.864462 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0a5bc4af-6a8c-44a1-a93b-883f3baf501f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:52.865254 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0a5bc4af-6a8c-44a1-a93b-883f3baf501f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:52.865688 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0a5bc4af-6a8c-44a1-a93b-883f3baf501f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:53.074970 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0a5bc4af-6a8c-44a1-a93b-883f3baf501f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:53.082948 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0a5bc4af-6a8c-44a1-a93b-883f3baf501f tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.231319 Feb 28 19:04:53.083582 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 198/399] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:52 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:53.573481 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5a9b476a-207f-42c4-b574-4b04659d3fe5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:53.574415 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5a9b476a-207f-42c4-b574-4b04659d3fe5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:53.581562 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5a9b476a-207f-42c4-b574-4b04659d3fe5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:53.582010 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5a9b476a-207f-42c4-b574-4b04659d3fe5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:53.582785 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5a9b476a-207f-42c4-b574-4b04659d3fe5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:53.583257 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5a9b476a-207f-42c4-b574-4b04659d3fe5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:53.647485 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5a9b476a-207f-42c4-b574-4b04659d3fe5 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078398 Feb 28 19:04:53.648039 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 202/400] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:53 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:54.100412 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-33dee625-71fc-45b3-8a7f-0cf55c5670a2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:54.100856 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-33dee625-71fc-45b3-8a7f-0cf55c5670a2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:54.108579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33dee625-71fc-45b3-8a7f-0cf55c5670a2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:54.109025 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33dee625-71fc-45b3-8a7f-0cf55c5670a2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:54.109790 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33dee625-71fc-45b3-8a7f-0cf55c5670a2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:54.110223 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33dee625-71fc-45b3-8a7f-0cf55c5670a2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:54.308104 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-33dee625-71fc-45b3-8a7f-0cf55c5670a2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:54.316239 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-33dee625-71fc-45b3-8a7f-0cf55c5670a2 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1314 microversion: 2.1 time: 0.219825 Feb 28 19:04:54.316789 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 199/401] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:54 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:54.528699 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8c8d1cc8-3131-4d87-8175-644b249a092a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b260d2f-6253-40e5-83c5-2ce4915842e4"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:04:54.529863 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8c8d1cc8-3131-4d87-8175-644b249a092a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:54.537291 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8d1cc8-3131-4d87-8175-644b249a092a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:54.537743 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8d1cc8-3131-4d87-8175-644b249a092a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:54.538541 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8d1cc8-3131-4d87-8175-644b249a092a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:54.538981 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8d1cc8-3131-4d87-8175-644b249a092a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:54.659691 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c5031596-5892-4d73-8dc9-f8e94eb60f6f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:54.661039 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c5031596-5892-4d73-8dc9-f8e94eb60f6f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:54.670383 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c5031596-5892-4d73-8dc9-f8e94eb60f6f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:54.671191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c5031596-5892-4d73-8dc9-f8e94eb60f6f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:54.672258 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c5031596-5892-4d73-8dc9-f8e94eb60f6f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:54.672889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c5031596-5892-4d73-8dc9-f8e94eb60f6f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:54.742233 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c5031596-5892-4d73-8dc9-f8e94eb60f6f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086935 Feb 28 19:04:54.742803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 200/402] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:04:54 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 19:04:55.332674 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a9e2a56d-550d-4e76-a133-ccad34419a1b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:55.333346 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a9e2a56d-550d-4e76-a133-ccad34419a1b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:55.340327 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a9e2a56d-550d-4e76-a133-ccad34419a1b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:55.340769 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a9e2a56d-550d-4e76-a133-ccad34419a1b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:55.341557 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a9e2a56d-550d-4e76-a133-ccad34419a1b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:55.341988 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a9e2a56d-550d-4e76-a133-ccad34419a1b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:55.549444 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a9e2a56d-550d-4e76-a133-ccad34419a1b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:55.558765 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a9e2a56d-550d-4e76-a133-ccad34419a1b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1498 microversion: 2.1 time: 0.229703 Feb 28 19:04:55.559407 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 201/403] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:55 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1498 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:04:55.880199 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8c8d1cc8-3131-4d87-8175-644b249a092a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "POST /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.356375 Feb 28 19:04:55.885672 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 203/404] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:04:54 2022] POST /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments => generated 194 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:04:57.049729 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f33d1bed-0a1e-4085-9a89-dec6494e495c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:57.050284 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f33d1bed-0a1e-4085-9a89-dec6494e495c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:57.063018 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f33d1bed-0a1e-4085-9a89-dec6494e495c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:57.063018 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f33d1bed-0a1e-4085-9a89-dec6494e495c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:57.063018 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f33d1bed-0a1e-4085-9a89-dec6494e495c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:57.063018 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f33d1bed-0a1e-4085-9a89-dec6494e495c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:57.128402 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f33d1bed-0a1e-4085-9a89-dec6494e495c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Going to try to terminate instance {{(pid=101792) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:04:57.581884 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f33d1bed-0a1e-4085-9a89-dec6494e495c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 204 len: 0 microversion: 2.1 time: 0.538012 Feb 28 19:04:57.582465 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 202/405] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:04:57 2022] DELETE /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:04:57.595920 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-43184271-2687-430c-8494-0c8b6f42580c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:57.596872 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-43184271-2687-430c-8494-0c8b6f42580c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:57.605116 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-43184271-2687-430c-8494-0c8b6f42580c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:57.605562 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-43184271-2687-430c-8494-0c8b6f42580c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:57.606338 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-43184271-2687-430c-8494-0c8b6f42580c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:57.606800 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-43184271-2687-430c-8494-0c8b6f42580c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:57.819736 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-43184271-2687-430c-8494-0c8b6f42580c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:57.828571 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-43184271-2687-430c-8494-0c8b6f42580c tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1504 microversion: 2.1 time: 0.236892 Feb 28 19:04:57.829069 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 204/406] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:57 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:58.205126 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f9d5796b-7a78-46bf-811e-e6c0bf75fc4f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:58.205710 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f9d5796b-7a78-46bf-811e-e6c0bf75fc4f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:58.215957 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f9d5796b-7a78-46bf-811e-e6c0bf75fc4f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:58.216411 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f9d5796b-7a78-46bf-811e-e6c0bf75fc4f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:58.217226 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f9d5796b-7a78-46bf-811e-e6c0bf75fc4f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:58.217659 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f9d5796b-7a78-46bf-811e-e6c0bf75fc4f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:58.281570 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f9d5796b-7a78-46bf-811e-e6c0bf75fc4f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Going to try to terminate instance {{(pid=101792) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:04:58.709048 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f9d5796b-7a78-46bf-811e-e6c0bf75fc4f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 204 len: 0 microversion: 2.1 time: 0.508113 Feb 28 19:04:58.709876 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 203/407] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:04:58 2022] DELETE /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:04:58.718290 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f24d3712-2d9f-4ada-8376-ee3a60ace388 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:58.719910 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f24d3712-2d9f-4ada-8376-ee3a60ace388 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:58.728322 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f24d3712-2d9f-4ada-8376-ee3a60ace388 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:58.728685 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f24d3712-2d9f-4ada-8376-ee3a60ace388 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:58.729463 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f24d3712-2d9f-4ada-8376-ee3a60ace388 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:58.729894 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f24d3712-2d9f-4ada-8376-ee3a60ace388 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:58.854542 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-55e3fd78-3b54-412d-b7de-44d465c4a9db tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:04:58.855264 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-55e3fd78-3b54-412d-b7de-44d465c4a9db tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:04:58.862625 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-55e3fd78-3b54-412d-b7de-44d465c4a9db tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:58.863075 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-55e3fd78-3b54-412d-b7de-44d465c4a9db tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:58.871420 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-55e3fd78-3b54-412d-b7de-44d465c4a9db tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:04:58.871420 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-55e3fd78-3b54-412d-b7de-44d465c4a9db tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:04:58.988932 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f24d3712-2d9f-4ada-8376-ee3a60ace388 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:58.998210 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f24d3712-2d9f-4ada-8376-ee3a60ace388 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1507 microversion: 2.1 time: 0.283665 Feb 28 19:04:58.999187 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 205/408] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:58 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1507 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:04:59.079726 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-55e3fd78-3b54-412d-b7de-44d465c4a9db tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:04:59.087779 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-55e3fd78-3b54-412d-b7de-44d465c4a9db tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1504 microversion: 2.1 time: 0.237415 Feb 28 19:04:59.088348 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 204/409] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:04:58 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:05:00.015770 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-73198695-a2f6-49f1-9916-81386ee0c061 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:00.016397 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-73198695-a2f6-49f1-9916-81386ee0c061 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:00.023543 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-73198695-a2f6-49f1-9916-81386ee0c061 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:00.024129 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-73198695-a2f6-49f1-9916-81386ee0c061 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:00.025445 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-73198695-a2f6-49f1-9916-81386ee0c061 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:00.025880 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-73198695-a2f6-49f1-9916-81386ee0c061 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:00.104554 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-530ae438-1485-4d3d-817c-77f4254c48fd tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:00.105191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-530ae438-1485-4d3d-817c-77f4254c48fd tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:00.112386 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-530ae438-1485-4d3d-817c-77f4254c48fd tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:00.112833 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-530ae438-1485-4d3d-817c-77f4254c48fd tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:00.113610 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-530ae438-1485-4d3d-817c-77f4254c48fd tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:00.114049 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-530ae438-1485-4d3d-817c-77f4254c48fd tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:00.286928 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-73198695-a2f6-49f1-9916-81386ee0c061 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:00.302343 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-73198695-a2f6-49f1-9916-81386ee0c061 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1507 microversion: 2.1 time: 0.286187 Feb 28 19:05:00.302343 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 206/410] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:00 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:00.367200 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-530ae438-1485-4d3d-817c-77f4254c48fd tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:00.379198 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-530ae438-1485-4d3d-817c-77f4254c48fd tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1504 microversion: 2.1 time: 0.278208 Feb 28 19:05:00.379803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 205/411] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:00 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:05:00.823043 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-31db8817-97be-40a7-a5b9-ed1d44af0256 req-dda8475f-506c-4ac8-809d-19a373d639de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d1e8b4d-5b60-4aa8-a2a6-312d9082e219", "name": "network-vif-deleted", "tag": "803d189d-eff4-4043-8232-89811430f5a5"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:00.824630 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:05:00.824630 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:05:00.832798 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-31db8817-97be-40a7-a5b9-ed1d44af0256 req-dda8475f-506c-4ac8-809d-19a373d639de service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:00.833232 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-31db8817-97be-40a7-a5b9-ed1d44af0256 req-dda8475f-506c-4ac8-809d-19a373d639de service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:00.848970 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-31db8817-97be-40a7-a5b9-ed1d44af0256 req-dda8475f-506c-4ac8-809d-19a373d639de service nova] Creating event network-vif-deleted:803d189d-eff4-4043-8232-89811430f5a5 for instance 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 on hv-cinder-83118 Feb 28 19:05:00.854304 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-31db8817-97be-40a7-a5b9-ed1d44af0256 req-dda8475f-506c-4ac8-809d-19a373d639de service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036298 Feb 28 19:05:00.854921 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 207/412] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:01.324602 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2dbe259a-bdd2-40d0-913d-944a986bb596 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:01.324602 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2dbe259a-bdd2-40d0-913d-944a986bb596 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:01.326259 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2dbe259a-bdd2-40d0-913d-944a986bb596 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:01.326708 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2dbe259a-bdd2-40d0-913d-944a986bb596 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:01.327507 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2dbe259a-bdd2-40d0-913d-944a986bb596 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:01.328008 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2dbe259a-bdd2-40d0-913d-944a986bb596 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:01.398414 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-39464c1c-68df-4630-b855-2844a82dae2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:01.399767 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-39464c1c-68df-4630-b855-2844a82dae2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:01.411099 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-39464c1c-68df-4630-b855-2844a82dae2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:01.412220 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-39464c1c-68df-4630-b855-2844a82dae2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:01.413507 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-39464c1c-68df-4630-b855-2844a82dae2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:01.414315 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-39464c1c-68df-4630-b855-2844a82dae2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:01.493721 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-39464c1c-68df-4630-b855-2844a82dae2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:01.494142 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-39464c1c-68df-4630-b855-2844a82dae2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:01.494590 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-39464c1c-68df-4630-b855-2844a82dae2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lazy-loading 'fault' on Instance uuid 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:05:01.563054 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-39464c1c-68df-4630-b855-2844a82dae2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3484bc7ebe7d4ddd972788b2ce5434ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdeeae6a56d4607962f8b0a1490547a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:01.571601 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-39464c1c-68df-4630-b855-2844a82dae2b tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 200 len: 1304 microversion: 2.1 time: 0.177182 Feb 28 19:05:01.572166 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 208/413] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:01 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 1304 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:05:01.593058 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2dbe259a-bdd2-40d0-913d-944a986bb596 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:01.601316 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2dbe259a-bdd2-40d0-913d-944a986bb596 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1507 microversion: 2.1 time: 0.287650 Feb 28 19:05:01.601909 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 206/414] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:01 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:02.588656 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7189908c-a28a-46e8-be5d-59fa4b8a4125 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:02.589506 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7189908c-a28a-46e8-be5d-59fa4b8a4125 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] [instance: 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:02.597103 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7189908c-a28a-46e8-be5d-59fa4b8a4125 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:02.597610 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7189908c-a28a-46e8-be5d-59fa4b8a4125 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:02.598454 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7189908c-a28a-46e8-be5d-59fa4b8a4125 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:02.598991 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7189908c-a28a-46e8-be5d-59fa4b8a4125 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:02.622047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-092894db-bdd2-4969-8ef7-cb873f31ee0f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:02.623372 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-092894db-bdd2-4969-8ef7-cb873f31ee0f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:02.635555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-092894db-bdd2-4969-8ef7-cb873f31ee0f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:02.637549 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-092894db-bdd2-4969-8ef7-cb873f31ee0f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:02.638614 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-092894db-bdd2-4969-8ef7-cb873f31ee0f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:02.639391 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-092894db-bdd2-4969-8ef7-cb873f31ee0f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:02.651477 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-7189908c-a28a-46e8-be5d-59fa4b8a4125 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] HTTP exception thrown: Instance 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 could not be found. Feb 28 19:05:02.652187 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7189908c-a28a-46e8-be5d-59fa4b8a4125 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] Returning 404 to user: Instance 1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:02.653091 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7189908c-a28a-46e8-be5d-59fa4b8a4125 tempest-VolumesActionsTest-546708665 tempest-VolumesActionsTest-546708665-project] 10.222.0.21 "GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219" status: 404 len: 111 microversion: 2.1 time: 0.068515 Feb 28 19:05:02.653724 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 209/415] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:02 2022] GET /compute/v2.1/servers/1d1e8b4d-5b60-4aa8-a2a6-312d9082e219 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:05:03.001522 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-092894db-bdd2-4969-8ef7-cb873f31ee0f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:03.014607 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-092894db-bdd2-4969-8ef7-cb873f31ee0f tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1507 microversion: 2.1 time: 0.399904 Feb 28 19:05:03.016325 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 207/416] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:02 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:03.229610 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-2becceb1-0e93-4b88-a204-c938c09c0650 req-5c85a377-5694-4e8e-8ecf-a737ca243251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8550549-20dd-427f-a2aa-0c06fc252947", "name": "network-vif-deleted", "tag": "563c7ae5-b2ec-4f78-aca8-56a58c48d7d3"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:03.231286 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:05:03.231286 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:05:03.240521 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-2becceb1-0e93-4b88-a204-c938c09c0650 req-5c85a377-5694-4e8e-8ecf-a737ca243251 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:03.241039 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-2becceb1-0e93-4b88-a204-c938c09c0650 req-5c85a377-5694-4e8e-8ecf-a737ca243251 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:03.279674 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-2becceb1-0e93-4b88-a204-c938c09c0650 req-5c85a377-5694-4e8e-8ecf-a737ca243251 service nova] Creating event network-vif-deleted:563c7ae5-b2ec-4f78-aca8-56a58c48d7d3 for instance d8550549-20dd-427f-a2aa-0c06fc252947 on hv-cinder-83118 Feb 28 19:05:03.279674 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-2becceb1-0e93-4b88-a204-c938c09c0650 req-5c85a377-5694-4e8e-8ecf-a737ca243251 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039176 Feb 28 19:05:03.279674 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 210/417] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:04.031737 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-33653795-fb9e-4617-86d6-e32dfa27f6df tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:04.033189 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-33653795-fb9e-4617-86d6-e32dfa27f6df tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:04.045418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33653795-fb9e-4617-86d6-e32dfa27f6df tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:04.045418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33653795-fb9e-4617-86d6-e32dfa27f6df tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:04.045418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33653795-fb9e-4617-86d6-e32dfa27f6df tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:04.045418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33653795-fb9e-4617-86d6-e32dfa27f6df tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:04.118453 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33653795-fb9e-4617-86d6-e32dfa27f6df tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:04.118824 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-33653795-fb9e-4617-86d6-e32dfa27f6df tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:04.119311 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-33653795-fb9e-4617-86d6-e32dfa27f6df tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lazy-loading 'fault' on Instance uuid d8550549-20dd-427f-a2aa-0c06fc252947 {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:05:04.184987 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-33653795-fb9e-4617-86d6-e32dfa27f6df tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:04.194631 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-33653795-fb9e-4617-86d6-e32dfa27f6df tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 200 len: 1312 microversion: 2.1 time: 0.166414 Feb 28 19:05:04.195580 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 208/418] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:04 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:05.039355 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7ca8b00e-996b-415c-8f06-627863ef1a2a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:05.040965 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7ca8b00e-996b-415c-8f06-627863ef1a2a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:05.048571 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7ca8b00e-996b-415c-8f06-627863ef1a2a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:05.049010 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7ca8b00e-996b-415c-8f06-627863ef1a2a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:05.049768 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7ca8b00e-996b-415c-8f06-627863ef1a2a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:05.050196 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7ca8b00e-996b-415c-8f06-627863ef1a2a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:05.205794 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-7ca8b00e-996b-415c-8f06-627863ef1a2a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lazy-loading 'services' on Instance uuid f0056e80-82b0-4042-b106-de36581e773c {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:05:05.213613 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b17758cf-3567-4e15-af63-2d3aed76e199 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:05.214308 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b17758cf-3567-4e15-af63-2d3aed76e199 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: d8550549-20dd-427f-a2aa-0c06fc252947] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:05.221588 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b17758cf-3567-4e15-af63-2d3aed76e199 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:05.222407 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b17758cf-3567-4e15-af63-2d3aed76e199 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:05.223436 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b17758cf-3567-4e15-af63-2d3aed76e199 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:05.224057 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b17758cf-3567-4e15-af63-2d3aed76e199 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:05.278045 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-b17758cf-3567-4e15-af63-2d3aed76e199 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] HTTP exception thrown: Instance d8550549-20dd-427f-a2aa-0c06fc252947 could not be found. Feb 28 19:05:05.278887 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b17758cf-3567-4e15-af63-2d3aed76e199 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Returning 404 to user: Instance d8550549-20dd-427f-a2aa-0c06fc252947 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:05.280007 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b17758cf-3567-4e15-af63-2d3aed76e199 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947" status: 404 len: 111 microversion: 2.1 time: 0.070998 Feb 28 19:05:05.280723 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 209/419] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:05 2022] GET /compute/v2.1/servers/d8550549-20dd-427f-a2aa-0c06fc252947 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 19:05:05.288293 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4f0b8f0c-d810-45b8-a5c4-7131c1e7733e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:05.288773 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4f0b8f0c-d810-45b8-a5c4-7131c1e7733e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:05.296449 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4f0b8f0c-d810-45b8-a5c4-7131c1e7733e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:05.296895 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4f0b8f0c-d810-45b8-a5c4-7131c1e7733e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:05.298476 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4f0b8f0c-d810-45b8-a5c4-7131c1e7733e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:05.298476 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4f0b8f0c-d810-45b8-a5c4-7131c1e7733e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:05.358762 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4f0b8f0c-d810-45b8-a5c4-7131c1e7733e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Going to try to terminate instance {{(pid=101792) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:05:05.555992 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7ca8b00e-996b-415c-8f06-627863ef1a2a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments/2b260d2f-6253-40e5-83c5-2ce4915842e4" status: 202 len: 0 microversion: 2.1 time: 0.520351 Feb 28 19:05:05.556697 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 211/420] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:05:05 2022] DELETE /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments/2b260d2f-6253-40e5-83c5-2ce4915842e4 => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:05:05.566247 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-503c31e6-7303-4175-8745-b9c96394b5c6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:05.567339 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-503c31e6-7303-4175-8745-b9c96394b5c6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:05.575080 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-503c31e6-7303-4175-8745-b9c96394b5c6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:05.575552 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-503c31e6-7303-4175-8745-b9c96394b5c6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:05.576440 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-503c31e6-7303-4175-8745-b9c96394b5c6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:05.576799 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-503c31e6-7303-4175-8745-b9c96394b5c6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:05.646520 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-503c31e6-7303-4175-8745-b9c96394b5c6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085142 Feb 28 19:05:05.647100 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 212/421] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:05:05 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:05:05.721815 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4f0b8f0c-d810-45b8-a5c4-7131c1e7733e tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "DELETE /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 204 len: 0 microversion: 2.1 time: 0.436564 Feb 28 19:05:05.722418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 210/422] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:05:05 2022] DELETE /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 28 19:05:05.730788 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b63097f3-6836-42c7-bdf2-e0798d96062a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:05.731416 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b63097f3-6836-42c7-bdf2-e0798d96062a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:05.738554 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b63097f3-6836-42c7-bdf2-e0798d96062a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:05.739003 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b63097f3-6836-42c7-bdf2-e0798d96062a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:05.739807 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b63097f3-6836-42c7-bdf2-e0798d96062a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:05.740242 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b63097f3-6836-42c7-bdf2-e0798d96062a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:05.938842 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b63097f3-6836-42c7-bdf2-e0798d96062a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:05.947798 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b63097f3-6836-42c7-bdf2-e0798d96062a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.221375 Feb 28 19:05:05.948445 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 213/423] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:05 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:06.659921 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-53f86227-17c1-4c15-a722-f1022fdb434f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:06.661126 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-53f86227-17c1-4c15-a722-f1022fdb434f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:06.669503 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-53f86227-17c1-4c15-a722-f1022fdb434f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:06.677775 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-53f86227-17c1-4c15-a722-f1022fdb434f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:06.677775 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-53f86227-17c1-4c15-a722-f1022fdb434f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:06.677775 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-53f86227-17c1-4c15-a722-f1022fdb434f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:06.737556 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-53f86227-17c1-4c15-a722-f1022fdb434f tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081867 Feb 28 19:05:06.738099 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 211/424] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:05:06 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:06.965805 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-407146f7-7417-479f-992f-5091a970008d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:06.967216 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-407146f7-7417-479f-992f-5091a970008d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:06.974466 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-407146f7-7417-479f-992f-5091a970008d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:06.974938 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-407146f7-7417-479f-992f-5091a970008d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:06.975772 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-407146f7-7417-479f-992f-5091a970008d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:06.976218 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-407146f7-7417-479f-992f-5091a970008d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:07.187281 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-407146f7-7417-479f-992f-5091a970008d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:07.195558 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-407146f7-7417-479f-992f-5091a970008d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.234616 Feb 28 19:05:07.196740 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 214/425] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:06 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:07.749683 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b8625eea-bd93-4e13-88ff-11d9b9b6bd32 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:07.752463 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b8625eea-bd93-4e13-88ff-11d9b9b6bd32 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:07.758101 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8625eea-bd93-4e13-88ff-11d9b9b6bd32 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:07.759107 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8625eea-bd93-4e13-88ff-11d9b9b6bd32 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:07.759918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8625eea-bd93-4e13-88ff-11d9b9b6bd32 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:07.760371 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8625eea-bd93-4e13-88ff-11d9b9b6bd32 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:07.825625 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b8625eea-bd93-4e13-88ff-11d9b9b6bd32 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079681 Feb 28 19:05:07.826186 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 212/426] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:05:07 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:08.213082 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-240cfd18-3545-4878-b641-473a32a20a3c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:08.213789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-240cfd18-3545-4878-b641-473a32a20a3c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:08.221328 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-240cfd18-3545-4878-b641-473a32a20a3c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:08.221844 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-240cfd18-3545-4878-b641-473a32a20a3c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:08.222836 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-240cfd18-3545-4878-b641-473a32a20a3c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:08.223315 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-240cfd18-3545-4878-b641-473a32a20a3c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:08.419969 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-240cfd18-3545-4878-b641-473a32a20a3c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:08.428074 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-240cfd18-3545-4878-b641-473a32a20a3c tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.218601 Feb 28 19:05:08.428645 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 215/427] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:08 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:08.837647 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a3a42ac3-e3e9-43da-ad58-bf33da662bc3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:08.839286 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a3a42ac3-e3e9-43da-ad58-bf33da662bc3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:08.846928 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a3a42ac3-e3e9-43da-ad58-bf33da662bc3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:08.847848 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a3a42ac3-e3e9-43da-ad58-bf33da662bc3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:08.848275 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a3a42ac3-e3e9-43da-ad58-bf33da662bc3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:08.848571 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a3a42ac3-e3e9-43da-ad58-bf33da662bc3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:08.914293 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a3a42ac3-e3e9-43da-ad58-bf33da662bc3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080968 Feb 28 19:05:08.920299 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 213/428] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:05:08 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:09.444564 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-40703cd7-e2d3-43cc-8d3e-a053048d7404 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:09.445181 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-40703cd7-e2d3-43cc-8d3e-a053048d7404 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:09.453177 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-40703cd7-e2d3-43cc-8d3e-a053048d7404 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:09.453618 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-40703cd7-e2d3-43cc-8d3e-a053048d7404 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:09.454497 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-40703cd7-e2d3-43cc-8d3e-a053048d7404 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:09.454917 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-40703cd7-e2d3-43cc-8d3e-a053048d7404 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:09.651050 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-40703cd7-e2d3-43cc-8d3e-a053048d7404 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:09.659486 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-40703cd7-e2d3-43cc-8d3e-a053048d7404 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.218522 Feb 28 19:05:09.660053 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 216/429] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:09 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:09.928038 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f6d0791b-8ffc-4482-b4a8-c7db24c866ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:09.928859 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f6d0791b-8ffc-4482-b4a8-c7db24c866ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:09.936365 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f6d0791b-8ffc-4482-b4a8-c7db24c866ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:09.936818 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f6d0791b-8ffc-4482-b4a8-c7db24c866ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:09.937578 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f6d0791b-8ffc-4482-b4a8-c7db24c866ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:09.938008 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f6d0791b-8ffc-4482-b4a8-c7db24c866ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:10.008619 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f6d0791b-8ffc-4482-b4a8-c7db24c866ce tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084225 Feb 28 19:05:10.009435 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 214/430] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:05:09 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:10.676603 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c197b3b3-b3d1-483e-895f-8fa9fc6fa05a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:10.677250 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c197b3b3-b3d1-483e-895f-8fa9fc6fa05a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:10.684721 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c197b3b3-b3d1-483e-895f-8fa9fc6fa05a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:10.685167 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c197b3b3-b3d1-483e-895f-8fa9fc6fa05a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:10.685942 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c197b3b3-b3d1-483e-895f-8fa9fc6fa05a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:10.686373 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c197b3b3-b3d1-483e-895f-8fa9fc6fa05a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:10.921572 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c197b3b3-b3d1-483e-895f-8fa9fc6fa05a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:10.929780 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c197b3b3-b3d1-483e-895f-8fa9fc6fa05a tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.256826 Feb 28 19:05:10.930815 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 217/431] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:10 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:11.019105 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-87852b7e-2ad8-4edc-b588-f86da4441c19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:11.020017 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-87852b7e-2ad8-4edc-b588-f86da4441c19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:11.027703 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-87852b7e-2ad8-4edc-b588-f86da4441c19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:11.028142 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-87852b7e-2ad8-4edc-b588-f86da4441c19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:11.028896 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-87852b7e-2ad8-4edc-b588-f86da4441c19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:11.029326 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-87852b7e-2ad8-4edc-b588-f86da4441c19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:11.097448 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-87852b7e-2ad8-4edc-b588-f86da4441c19 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082042 Feb 28 19:05:11.098158 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 215/432] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:05:11 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:11.949280 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-075465bb-08e5-4759-be0a-26a65243d9f3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:11.951352 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-075465bb-08e5-4759-be0a-26a65243d9f3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:11.962254 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-075465bb-08e5-4759-be0a-26a65243d9f3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:11.963025 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-075465bb-08e5-4759-be0a-26a65243d9f3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:11.964324 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-075465bb-08e5-4759-be0a-26a65243d9f3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:11.965007 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-075465bb-08e5-4759-be0a-26a65243d9f3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:12.110880 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-5f8278e5-c513-4411-b559-944d665da00b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:12.115430 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5f8278e5-c513-4411-b559-944d665da00b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:12.126038 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5f8278e5-c513-4411-b559-944d665da00b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:12.126396 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5f8278e5-c513-4411-b559-944d665da00b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:12.127191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5f8278e5-c513-4411-b559-944d665da00b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:12.127627 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5f8278e5-c513-4411-b559-944d665da00b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:12.216127 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-075465bb-08e5-4759-be0a-26a65243d9f3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:12.223645 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-5f8278e5-c513-4411-b559-944d665da00b tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118078 Feb 28 19:05:12.224421 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 216/433] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:05:12 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 19:05:12.225597 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-075465bb-08e5-4759-be0a-26a65243d9f3 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.282682 Feb 28 19:05:12.226169 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 218/434] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:11 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:13.098089 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f1233df0-cdaa-4fdf-866b-41e50c0c98f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97d1363f-4d05-47c3-8e16-8b5adabc92a9"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:13.107395 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f1233df0-cdaa-4fdf-866b-41e50c0c98f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:13.130708 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1233df0-cdaa-4fdf-866b-41e50c0c98f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:13.151912 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1233df0-cdaa-4fdf-866b-41e50c0c98f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:13.151912 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1233df0-cdaa-4fdf-866b-41e50c0c98f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:13.151912 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f1233df0-cdaa-4fdf-866b-41e50c0c98f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:13.244831 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-912bb168-25ea-495c-b007-28456e75a90d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:13.246533 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-912bb168-25ea-495c-b007-28456e75a90d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:13.268270 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-912bb168-25ea-495c-b007-28456e75a90d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:13.271290 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-912bb168-25ea-495c-b007-28456e75a90d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:13.272494 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-912bb168-25ea-495c-b007-28456e75a90d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:13.277721 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-912bb168-25ea-495c-b007-28456e75a90d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:13.697035 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-912bb168-25ea-495c-b007-28456e75a90d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:13.706177 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-912bb168-25ea-495c-b007-28456e75a90d tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.466082 Feb 28 19:05:13.708041 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 219/435] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:13 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:13.886662 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-11dd5f0b-b9ef-4de3-a018-615a47548afd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:13.887467 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-11dd5f0b-b9ef-4de3-a018-615a47548afd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:13.896412 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-11dd5f0b-b9ef-4de3-a018-615a47548afd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:13.897075 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-11dd5f0b-b9ef-4de3-a018-615a47548afd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:13.898007 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-11dd5f0b-b9ef-4de3-a018-615a47548afd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:13.899222 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-11dd5f0b-b9ef-4de3-a018-615a47548afd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:13.972572 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-11dd5f0b-b9ef-4de3-a018-615a47548afd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Going to try to terminate instance {{(pid=101791) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:05:14.681402 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-11dd5f0b-b9ef-4de3-a018-615a47548afd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "DELETE /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 204 len: 0 microversion: 2.1 time: 0.799413 Feb 28 19:05:14.684011 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 220/436] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:05:13 2022] DELETE /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 0 bytes in 802 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:05:14.691562 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-36c5e3b8-b5db-4060-bcbe-ce657eb30e90 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:14.692730 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-36c5e3b8-b5db-4060-bcbe-ce657eb30e90 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:14.710420 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36c5e3b8-b5db-4060-bcbe-ce657eb30e90 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:14.711534 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36c5e3b8-b5db-4060-bcbe-ce657eb30e90 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:14.713047 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36c5e3b8-b5db-4060-bcbe-ce657eb30e90 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:14.713742 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36c5e3b8-b5db-4060-bcbe-ce657eb30e90 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:14.862903 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f1233df0-cdaa-4fdf-866b-41e50c0c98f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "POST /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.793628 Feb 28 19:05:14.863711 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 217/437] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:05:13 2022] POST /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/os-volume_attachments => generated 194 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:14.875746 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-acf199cb-ddd8-4475-8a57-ecd67c97bdd1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:14.876490 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-acf199cb-ddd8-4475-8a57-ecd67c97bdd1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:14.885858 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-acf199cb-ddd8-4475-8a57-ecd67c97bdd1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:14.886293 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-acf199cb-ddd8-4475-8a57-ecd67c97bdd1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:14.887068 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-acf199cb-ddd8-4475-8a57-ecd67c97bdd1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:14.887528 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-acf199cb-ddd8-4475-8a57-ecd67c97bdd1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:14.926830 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-36c5e3b8-b5db-4060-bcbe-ce657eb30e90 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:14.936275 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-36c5e3b8-b5db-4060-bcbe-ce657eb30e90 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1513 microversion: 2.1 time: 0.248879 Feb 28 19:05:14.936978 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 221/438] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:14 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:05:14.947989 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8f8f8056-4a89-4eb9-bb67-761e60d423b4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:14.948542 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8f8f8056-4a89-4eb9-bb67-761e60d423b4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:14.956812 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8f8f8056-4a89-4eb9-bb67-761e60d423b4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:14.957336 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8f8f8056-4a89-4eb9-bb67-761e60d423b4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:14.958181 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8f8f8056-4a89-4eb9-bb67-761e60d423b4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:14.958757 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8f8f8056-4a89-4eb9-bb67-761e60d423b4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:15.020798 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-8f8f8056-4a89-4eb9-bb67-761e60d423b4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lazy-loading 'flavor' on Instance uuid 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:05:15.138873 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-acf199cb-ddd8-4475-8a57-ecd67c97bdd1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:15.150829 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-acf199cb-ddd8-4475-8a57-ecd67c97bdd1 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.285621 Feb 28 19:05:15.153081 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 218/439] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:14 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:15.853401 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8f8f8056-4a89-4eb9-bb67-761e60d423b4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "POST /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/action" status: 202 len: 0 microversion: 2.20 time: 0.915039 Feb 28 19:05:15.862013 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-77916e1f-59bf-4c4a-9a1c-7372cd12c12a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:15.862629 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-77916e1f-59bf-4c4a-9a1c-7372cd12c12a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:15.871373 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 222/440] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Feb 28 19:05:14 2022] POST /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/action => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:05:15.871609 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-77916e1f-59bf-4c4a-9a1c-7372cd12c12a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:15.872062 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-77916e1f-59bf-4c4a-9a1c-7372cd12c12a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:15.873004 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-77916e1f-59bf-4c4a-9a1c-7372cd12c12a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:15.873446 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-77916e1f-59bf-4c4a-9a1c-7372cd12c12a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:15.956714 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9cbdb75a-ad09-481d-8f75-b9f55c3f8ec4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:15.957829 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9cbdb75a-ad09-481d-8f75-b9f55c3f8ec4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:15.984368 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9cbdb75a-ad09-481d-8f75-b9f55c3f8ec4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:15.984828 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9cbdb75a-ad09-481d-8f75-b9f55c3f8ec4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:15.986434 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9cbdb75a-ad09-481d-8f75-b9f55c3f8ec4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:15.986879 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9cbdb75a-ad09-481d-8f75-b9f55c3f8ec4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:16.418613 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-77916e1f-59bf-4c4a-9a1c-7372cd12c12a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:16.436183 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-77916e1f-59bf-4c4a-9a1c-7372cd12c12a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:16.452403 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-77916e1f-59bf-4c4a-9a1c-7372cd12c12a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:16.453797 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-77916e1f-59bf-4c4a-9a1c-7372cd12c12a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.595433 Feb 28 19:05:16.454361 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 219/441] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:15 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:05:16.467407 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7d91c0e5-7514-483f-88de-2afb62009932 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:16.467407 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7d91c0e5-7514-483f-88de-2afb62009932 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:16.469898 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d91c0e5-7514-483f-88de-2afb62009932 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:16.474455 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d91c0e5-7514-483f-88de-2afb62009932 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:16.475540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d91c0e5-7514-483f-88de-2afb62009932 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:16.476144 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d91c0e5-7514-483f-88de-2afb62009932 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:16.479573 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9cbdb75a-ad09-481d-8f75-b9f55c3f8ec4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:16.495351 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9cbdb75a-ad09-481d-8f75-b9f55c3f8ec4 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1513 microversion: 2.1 time: 0.545329 Feb 28 19:05:16.497574 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 223/442] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:15 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1513 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:16.799218 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7d91c0e5-7514-483f-88de-2afb62009932 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:16.812565 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7d91c0e5-7514-483f-88de-2afb62009932 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1519 microversion: 2.1 time: 0.356901 Feb 28 19:05:16.813139 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 220/443] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:16 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1519 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:17.080802 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-62f51b9c-0774-46b3-afd3-520636153dc8 req-49932fd6-ad40-4cfe-b2f3-8725c0670f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26980bce-633e-4e70-9ebd-c1a38fb5cc4a", "name": "network-vif-deleted", "tag": "e2dd1567-70f3-42c6-b7f4-bc55d9e367c2"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:17.083720 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:05:17.083720 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:05:17.107585 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-62f51b9c-0774-46b3-afd3-520636153dc8 req-49932fd6-ad40-4cfe-b2f3-8725c0670f2e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:17.108024 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-62f51b9c-0774-46b3-afd3-520636153dc8 req-49932fd6-ad40-4cfe-b2f3-8725c0670f2e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:17.138704 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-62f51b9c-0774-46b3-afd3-520636153dc8 req-49932fd6-ad40-4cfe-b2f3-8725c0670f2e service nova] Creating event network-vif-deleted:e2dd1567-70f3-42c6-b7f4-bc55d9e367c2 for instance 26980bce-633e-4e70-9ebd-c1a38fb5cc4a on hv-cinder-83118 Feb 28 19:05:17.146221 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-62f51b9c-0774-46b3-afd3-520636153dc8 req-49932fd6-ad40-4cfe-b2f3-8725c0670f2e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069724 Feb 28 19:05:17.147796 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 224/444] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:17.481830 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0dcd5904-aa4e-4e48-9b3e-9977b01f71f0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:17.482442 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0dcd5904-aa4e-4e48-9b3e-9977b01f71f0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:17.501048 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0dcd5904-aa4e-4e48-9b3e-9977b01f71f0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:17.501785 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0dcd5904-aa4e-4e48-9b3e-9977b01f71f0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:17.502854 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0dcd5904-aa4e-4e48-9b3e-9977b01f71f0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:17.503565 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0dcd5904-aa4e-4e48-9b3e-9977b01f71f0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:17.516566 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d9b51b6c-da69-477f-a018-9afe77322dca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:17.519399 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d9b51b6c-da69-477f-a018-9afe77322dca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:17.557648 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d9b51b6c-da69-477f-a018-9afe77322dca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:17.559917 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d9b51b6c-da69-477f-a018-9afe77322dca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:17.562065 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d9b51b6c-da69-477f-a018-9afe77322dca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:17.563738 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d9b51b6c-da69-477f-a018-9afe77322dca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:17.912641 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d9b51b6c-da69-477f-a018-9afe77322dca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:17.924700 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d9b51b6c-da69-477f-a018-9afe77322dca tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1513 microversion: 2.1 time: 0.412948 Feb 28 19:05:17.936167 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 225/445] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:17 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1513 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:17.946380 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5b9a9047-5440-4ad1-8275-7d53ad2dd1c2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:17.951850 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5b9a9047-5440-4ad1-8275-7d53ad2dd1c2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:17.963661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5b9a9047-5440-4ad1-8275-7d53ad2dd1c2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:17.966767 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5b9a9047-5440-4ad1-8275-7d53ad2dd1c2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:17.967865 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5b9a9047-5440-4ad1-8275-7d53ad2dd1c2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:17.973922 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5b9a9047-5440-4ad1-8275-7d53ad2dd1c2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:17.975950 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0dcd5904-aa4e-4e48-9b3e-9977b01f71f0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:17.992489 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0dcd5904-aa4e-4e48-9b3e-9977b01f71f0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:18.003622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0dcd5904-aa4e-4e48-9b3e-9977b01f71f0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:18.006313 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0dcd5904-aa4e-4e48-9b3e-9977b01f71f0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.528514 Feb 28 19:05:18.006910 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 221/446] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:17 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:05:18.084115 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5b9a9047-5440-4ad1-8275-7d53ad2dd1c2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:18.085369 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5b9a9047-5440-4ad1-8275-7d53ad2dd1c2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:18.086073 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-5b9a9047-5440-4ad1-8275-7d53ad2dd1c2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lazy-loading 'fault' on Instance uuid 26980bce-633e-4e70-9ebd-c1a38fb5cc4a {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:05:18.163556 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5b9a9047-5440-4ad1-8275-7d53ad2dd1c2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b929b39cef7546a59987075cdef32d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d685b5629d4a8185474969249dbc6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:18.173257 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5b9a9047-5440-4ad1-8275-7d53ad2dd1c2 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 200 len: 1310 microversion: 2.1 time: 0.235631 Feb 28 19:05:18.174791 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 226/447] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:17 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 1310 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:18.957267 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0606eff1-c3e1-489c-8509-42a92f3514f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:18.957267 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0606eff1-c3e1-489c-8509-42a92f3514f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:18.985569 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0606eff1-c3e1-489c-8509-42a92f3514f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:18.992853 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0606eff1-c3e1-489c-8509-42a92f3514f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:18.995807 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0606eff1-c3e1-489c-8509-42a92f3514f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:18.998760 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0606eff1-c3e1-489c-8509-42a92f3514f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:19.030975 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-da75f140-74fd-419f-b470-ec4eb5a25f3a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:19.031783 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-da75f140-74fd-419f-b470-ec4eb5a25f3a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:19.058191 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da75f140-74fd-419f-b470-ec4eb5a25f3a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:19.060970 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da75f140-74fd-419f-b470-ec4eb5a25f3a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:19.062894 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da75f140-74fd-419f-b470-ec4eb5a25f3a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:19.064105 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da75f140-74fd-419f-b470-ec4eb5a25f3a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:19.236046 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0606eff1-c3e1-489c-8509-42a92f3514f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:19.247416 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0606eff1-c3e1-489c-8509-42a92f3514f7 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1471 microversion: 2.1 time: 0.306946 Feb 28 19:05:19.251043 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 222/448] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:18 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:19.262098 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-8d30bbc5-1cc6-4d43-9cde-74a6846a7376 req-d59050de-6a99-409e-a9dd-9020d54d1c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0056e80-82b0-4042-b106-de36581e773c", "name": "network-vif-deleted", "tag": "8f626c26-4ced-4885-8f45-4bd5d5e7e95c"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:19.269493 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:05:19.269493 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:05:19.278374 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-8d30bbc5-1cc6-4d43-9cde-74a6846a7376 req-d59050de-6a99-409e-a9dd-9020d54d1c45 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:19.279057 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-8d30bbc5-1cc6-4d43-9cde-74a6846a7376 req-d59050de-6a99-409e-a9dd-9020d54d1c45 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:19.297158 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-8d30bbc5-1cc6-4d43-9cde-74a6846a7376 req-d59050de-6a99-409e-a9dd-9020d54d1c45 service nova] Creating event network-vif-deleted:8f626c26-4ced-4885-8f45-4bd5d5e7e95c for instance f0056e80-82b0-4042-b106-de36581e773c on hv-cinder-83118 Feb 28 19:05:19.342826 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-8d30bbc5-1cc6-4d43-9cde-74a6846a7376 req-d59050de-6a99-409e-a9dd-9020d54d1c45 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050123 Feb 28 19:05:19.342826 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 223/449] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:19.342826 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-23150fd4-5c79-48e0-8ccb-c5319ec50446 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:19.342826 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-23150fd4-5c79-48e0-8ccb-c5319ec50446 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] [instance: 26980bce-633e-4e70-9ebd-c1a38fb5cc4a] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:19.342826 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-23150fd4-5c79-48e0-8ccb-c5319ec50446 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:19.343475 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-23150fd4-5c79-48e0-8ccb-c5319ec50446 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:19.343475 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-23150fd4-5c79-48e0-8ccb-c5319ec50446 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:19.343475 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-23150fd4-5c79-48e0-8ccb-c5319ec50446 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:19.358792 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-da75f140-74fd-419f-b470-ec4eb5a25f3a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:19.370045 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-da75f140-74fd-419f-b470-ec4eb5a25f3a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:19.372390 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-da75f140-74fd-419f-b470-ec4eb5a25f3a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:19.374219 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-da75f140-74fd-419f-b470-ec4eb5a25f3a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.347139 Feb 28 19:05:19.375442 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 227/450] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:19 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:19.388763 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-23150fd4-5c79-48e0-8ccb-c5319ec50446 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] HTTP exception thrown: Instance 26980bce-633e-4e70-9ebd-c1a38fb5cc4a could not be found. Feb 28 19:05:19.388763 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-23150fd4-5c79-48e0-8ccb-c5319ec50446 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] Returning 404 to user: Instance 26980bce-633e-4e70-9ebd-c1a38fb5cc4a could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:19.388763 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-23150fd4-5c79-48e0-8ccb-c5319ec50446 tempest-ServerRescueNegativeTestJSON-2059301180 tempest-ServerRescueNegativeTestJSON-2059301180-project] 10.222.0.21 "GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a" status: 404 len: 111 microversion: 2.1 time: 0.072484 Feb 28 19:05:19.388763 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 224/451] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:19 2022] GET /compute/v2.1/servers/26980bce-633e-4e70-9ebd-c1a38fb5cc4a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:05:20.265591 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-489dec93-1ec8-44d1-9bf9-dec2cdd63015 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:20.266506 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-489dec93-1ec8-44d1-9bf9-dec2cdd63015 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:20.274367 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-489dec93-1ec8-44d1-9bf9-dec2cdd63015 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:20.275505 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-489dec93-1ec8-44d1-9bf9-dec2cdd63015 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:20.282537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-489dec93-1ec8-44d1-9bf9-dec2cdd63015 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:20.282537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-489dec93-1ec8-44d1-9bf9-dec2cdd63015 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:20.360195 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-489dec93-1ec8-44d1-9bf9-dec2cdd63015 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:20.361344 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-489dec93-1ec8-44d1-9bf9-dec2cdd63015 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:20.361979 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-489dec93-1ec8-44d1-9bf9-dec2cdd63015 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lazy-loading 'fault' on Instance uuid f0056e80-82b0-4042-b106-de36581e773c {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:05:20.392824 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a212f65d-5aaa-4cf3-ab1d-031bc5e14844 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:20.393482 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a212f65d-5aaa-4cf3-ab1d-031bc5e14844 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:20.412211 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a212f65d-5aaa-4cf3-ab1d-031bc5e14844 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:20.414027 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a212f65d-5aaa-4cf3-ab1d-031bc5e14844 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:20.416916 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a212f65d-5aaa-4cf3-ab1d-031bc5e14844 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:20.419363 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a212f65d-5aaa-4cf3-ab1d-031bc5e14844 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:20.424202 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-489dec93-1ec8-44d1-9bf9-dec2cdd63015 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:20.435872 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-489dec93-1ec8-44d1-9bf9-dec2cdd63015 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 200 len: 1308 microversion: 2.1 time: 0.173913 Feb 28 19:05:20.436685 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 228/452] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:20 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:20.716176 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a212f65d-5aaa-4cf3-ab1d-031bc5e14844 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:20.728173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a212f65d-5aaa-4cf3-ab1d-031bc5e14844 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:20.730497 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a212f65d-5aaa-4cf3-ab1d-031bc5e14844 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:20.731908 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a212f65d-5aaa-4cf3-ab1d-031bc5e14844 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.343183 Feb 28 19:05:20.732622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 225/453] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:20 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:05:20.860432 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:05:20.861064 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: Mon Feb 28 19:05:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:05:21.455769 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7c90b46b-4ab4-42f9-b7f9-6f1260b9a1ba tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:21.458027 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7c90b46b-4ab4-42f9-b7f9-6f1260b9a1ba tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: f0056e80-82b0-4042-b106-de36581e773c] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:21.477898 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7c90b46b-4ab4-42f9-b7f9-6f1260b9a1ba tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:21.478609 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7c90b46b-4ab4-42f9-b7f9-6f1260b9a1ba tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:21.479684 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7c90b46b-4ab4-42f9-b7f9-6f1260b9a1ba tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:21.480484 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7c90b46b-4ab4-42f9-b7f9-6f1260b9a1ba tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:21.533965 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-7c90b46b-4ab4-42f9-b7f9-6f1260b9a1ba tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] HTTP exception thrown: Instance f0056e80-82b0-4042-b106-de36581e773c could not be found. Feb 28 19:05:21.534735 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7c90b46b-4ab4-42f9-b7f9-6f1260b9a1ba tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Returning 404 to user: Instance f0056e80-82b0-4042-b106-de36581e773c could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:21.535909 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7c90b46b-4ab4-42f9-b7f9-6f1260b9a1ba tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c" status: 404 len: 111 microversion: 2.1 time: 0.086336 Feb 28 19:05:21.540536 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 229/454] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:21 2022] GET /compute/v2.1/servers/f0056e80-82b0-4042-b106-de36581e773c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:05:21.755214 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1b3ef414-c096-42c9-9cf2-747b796b1dae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:21.758566 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1b3ef414-c096-42c9-9cf2-747b796b1dae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:21.781130 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1b3ef414-c096-42c9-9cf2-747b796b1dae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:21.781960 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1b3ef414-c096-42c9-9cf2-747b796b1dae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:21.783043 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1b3ef414-c096-42c9-9cf2-747b796b1dae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:21.783648 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1b3ef414-c096-42c9-9cf2-747b796b1dae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:22.049244 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1b3ef414-c096-42c9-9cf2-747b796b1dae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:22.071012 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1b3ef414-c096-42c9-9cf2-747b796b1dae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:22.074596 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1b3ef414-c096-42c9-9cf2-747b796b1dae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:22.076179 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1b3ef414-c096-42c9-9cf2-747b796b1dae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.326965 Feb 28 19:05:22.076989 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 226/455] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:21 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:22.987053 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:05:22.992772 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: Mon Feb 28 19:05:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:05:23.097063 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-330a5f4b-0037-4f5b-b31a-e7e2420c9dfb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:23.097998 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-330a5f4b-0037-4f5b-b31a-e7e2420c9dfb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:23.111528 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-330a5f4b-0037-4f5b-b31a-e7e2420c9dfb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:23.120723 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-330a5f4b-0037-4f5b-b31a-e7e2420c9dfb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:23.121894 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-330a5f4b-0037-4f5b-b31a-e7e2420c9dfb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:23.122495 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-330a5f4b-0037-4f5b-b31a-e7e2420c9dfb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:23.242143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-3f25769e-8be3-4012-89eb-5f7011c6d8f2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:23.242712 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3f25769e-8be3-4012-89eb-5f7011c6d8f2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:23.250964 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3f25769e-8be3-4012-89eb-5f7011c6d8f2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:23.256746 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3f25769e-8be3-4012-89eb-5f7011c6d8f2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:23.258186 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3f25769e-8be3-4012-89eb-5f7011c6d8f2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:23.263529 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3f25769e-8be3-4012-89eb-5f7011c6d8f2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:23.438328 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3f25769e-8be3-4012-89eb-5f7011c6d8f2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Going to try to terminate instance {{(pid=101792) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:05:23.728707 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-330a5f4b-0037-4f5b-b31a-e7e2420c9dfb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:23.741572 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-330a5f4b-0037-4f5b-b31a-e7e2420c9dfb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:23.743925 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-330a5f4b-0037-4f5b-b31a-e7e2420c9dfb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:23.745176 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-330a5f4b-0037-4f5b-b31a-e7e2420c9dfb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.651927 Feb 28 19:05:23.746601 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 230/456] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:23 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:24.129150 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-3f25769e-8be3-4012-89eb-5f7011c6d8f2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 204 len: 0 microversion: 2.1 time: 0.890241 Feb 28 19:05:24.136404 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 227/457] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:05:23 2022] DELETE /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:05:24.141265 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c61a4920-3cf3-4b58-b50d-d22759056200 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:24.142539 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c61a4920-3cf3-4b58-b50d-d22759056200 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:24.158253 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c61a4920-3cf3-4b58-b50d-d22759056200 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:24.158938 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c61a4920-3cf3-4b58-b50d-d22759056200 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:24.161106 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c61a4920-3cf3-4b58-b50d-d22759056200 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:24.161761 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c61a4920-3cf3-4b58-b50d-d22759056200 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:24.372330 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-82244279-3945-4031-8bad-20b9a0584314 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:24.385908 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-82244279-3945-4031-8bad-20b9a0584314 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:24.386857 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-82244279-3945-4031-8bad-20b9a0584314 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:24.479368 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-82244279-3945-4031-8bad-20b9a0584314 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Going to try to stop instance {{(pid=101792) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Feb 28 19:05:24.865228 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-82244279-3945-4031-8bad-20b9a0584314 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "POST /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/action" status: 202 len: 0 microversion: 2.1 time: 0.497426 Feb 28 19:05:24.869236 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 228/458] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:05:24 2022] POST /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:05:24.877904 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7c00b18e-0c76-4849-b937-43c81f635c66 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:24.878611 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7c00b18e-0c76-4849-b937-43c81f635c66 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:24.889722 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7c00b18e-0c76-4849-b937-43c81f635c66 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:24.890343 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7c00b18e-0c76-4849-b937-43c81f635c66 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:24.891285 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7c00b18e-0c76-4849-b937-43c81f635c66 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:24.891834 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7c00b18e-0c76-4849-b937-43c81f635c66 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:25.038911 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c61a4920-3cf3-4b58-b50d-d22759056200 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:25.060696 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c61a4920-3cf3-4b58-b50d-d22759056200 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1512 microversion: 2.1 time: 0.922970 Feb 28 19:05:25.061352 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 231/459] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:24 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1512 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:25.075472 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0f608d30-2bbb-49fc-936e-7a6c6687c412 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:25.076079 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0f608d30-2bbb-49fc-936e-7a6c6687c412 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:25.083781 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0f608d30-2bbb-49fc-936e-7a6c6687c412 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:25.087711 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0f608d30-2bbb-49fc-936e-7a6c6687c412 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:25.090940 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0f608d30-2bbb-49fc-936e-7a6c6687c412 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:25.091581 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0f608d30-2bbb-49fc-936e-7a6c6687c412 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:25.273676 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7c00b18e-0c76-4849-b937-43c81f635c66 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:25.284931 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7c00b18e-0c76-4849-b937-43c81f635c66 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:25.286641 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7c00b18e-0c76-4849-b937-43c81f635c66 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:25.288021 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7c00b18e-0c76-4849-b937-43c81f635c66 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.417716 Feb 28 19:05:25.300052 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 229/460] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:24 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:25.896895 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0f608d30-2bbb-49fc-936e-7a6c6687c412 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:25.926064 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0f608d30-2bbb-49fc-936e-7a6c6687c412 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1722 microversion: 2.1 time: 0.863166 Feb 28 19:05:25.926749 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 232/461] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:25 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1722 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:26.079816 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-bf2e9ec9-deb1-4a38-bc44-f6db2e85308a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:26.080472 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-bf2e9ec9-deb1-4a38-bc44-f6db2e85308a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:26.088381 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf2e9ec9-deb1-4a38-bc44-f6db2e85308a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:26.088823 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf2e9ec9-deb1-4a38-bc44-f6db2e85308a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:26.089648 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf2e9ec9-deb1-4a38-bc44-f6db2e85308a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:26.090116 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf2e9ec9-deb1-4a38-bc44-f6db2e85308a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:26.307849 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-16485693-752a-4dc9-967f-29703442cfce tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:26.308584 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-16485693-752a-4dc9-967f-29703442cfce tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:26.316145 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-16485693-752a-4dc9-967f-29703442cfce tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:26.319052 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-16485693-752a-4dc9-967f-29703442cfce tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:26.319052 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-16485693-752a-4dc9-967f-29703442cfce tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:26.319052 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-16485693-752a-4dc9-967f-29703442cfce tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:26.653824 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-bf2e9ec9-deb1-4a38-bc44-f6db2e85308a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:26.662541 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-bf2e9ec9-deb1-4a38-bc44-f6db2e85308a tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1512 microversion: 2.1 time: 0.586503 Feb 28 19:05:26.672481 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 230/462] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:26 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1512 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:26.791960 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-16485693-752a-4dc9-967f-29703442cfce tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:26.804660 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-16485693-752a-4dc9-967f-29703442cfce tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:26.811136 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-16485693-752a-4dc9-967f-29703442cfce tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:26.811136 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-16485693-752a-4dc9-967f-29703442cfce tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.504888 Feb 28 19:05:26.823805 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 233/463] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:26 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:05:26.945221 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-df45105b-15b0-42be-9c10-f8221adaf147 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:26.945843 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-df45105b-15b0-42be-9c10-f8221adaf147 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:26.958593 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df45105b-15b0-42be-9c10-f8221adaf147 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:26.959451 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df45105b-15b0-42be-9c10-f8221adaf147 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:26.960657 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df45105b-15b0-42be-9c10-f8221adaf147 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:26.961101 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df45105b-15b0-42be-9c10-f8221adaf147 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:27.661943 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-df45105b-15b0-42be-9c10-f8221adaf147 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:27.679320 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-df45105b-15b0-42be-9c10-f8221adaf147 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1722 microversion: 2.1 time: 0.733050 Feb 28 19:05:27.679320 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 231/464] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:26 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1722 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:27.688538 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6338914f-3c2d-4b81-abe2-11ba902f9bbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:27.689151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-6338914f-3c2d-4b81-abe2-11ba902f9bbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:27.697181 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6338914f-3c2d-4b81-abe2-11ba902f9bbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:27.697674 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6338914f-3c2d-4b81-abe2-11ba902f9bbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:27.698499 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6338914f-3c2d-4b81-abe2-11ba902f9bbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:27.699098 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6338914f-3c2d-4b81-abe2-11ba902f9bbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:27.827855 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2871388f-f322-4966-970a-d411e597be3f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:27.828857 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2871388f-f322-4966-970a-d411e597be3f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:27.844986 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2871388f-f322-4966-970a-d411e597be3f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:27.845794 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2871388f-f322-4966-970a-d411e597be3f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:27.847002 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2871388f-f322-4966-970a-d411e597be3f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:27.847675 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2871388f-f322-4966-970a-d411e597be3f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:28.199816 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6338914f-3c2d-4b81-abe2-11ba902f9bbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:28.211979 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6338914f-3c2d-4b81-abe2-11ba902f9bbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1470 microversion: 2.1 time: 0.532680 Feb 28 19:05:28.212235 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 234/465] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:27 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1470 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:05:28.216861 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-b9225513-18d9-420b-8f2f-12ef4e81db32 req-1915843c-6a36-48be-8086-49149c07b361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fea77b98-2b78-485a-beab-edf47a4fcc72", "name": "network-vif-deleted", "tag": "4446a787-0e66-4e50-9cbc-2341e7399a85"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:28.224183 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:05:28.224183 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:05:28.241580 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-b9225513-18d9-420b-8f2f-12ef4e81db32 req-1915843c-6a36-48be-8086-49149c07b361 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:28.242345 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-b9225513-18d9-420b-8f2f-12ef4e81db32 req-1915843c-6a36-48be-8086-49149c07b361 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:28.266793 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-b9225513-18d9-420b-8f2f-12ef4e81db32 req-1915843c-6a36-48be-8086-49149c07b361 service nova] Creating event network-vif-deleted:4446a787-0e66-4e50-9cbc-2341e7399a85 for instance fea77b98-2b78-485a-beab-edf47a4fcc72 on hv-cinder-83118 Feb 28 19:05:28.307651 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-b9225513-18d9-420b-8f2f-12ef4e81db32 req-1915843c-6a36-48be-8086-49149c07b361 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093984 Feb 28 19:05:28.314151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 235/466] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:28.374763 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2871388f-f322-4966-970a-d411e597be3f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:28.385445 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2871388f-f322-4966-970a-d411e597be3f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:28.388518 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2871388f-f322-4966-970a-d411e597be3f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:28.390315 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2871388f-f322-4966-970a-d411e597be3f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.566404 Feb 28 19:05:28.391419 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 232/467] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:27 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:28.696058 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e656a733-16df-41ed-8ef7-db25fe0f4e05 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:28.697606 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e656a733-16df-41ed-8ef7-db25fe0f4e05 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:28.707390 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e656a733-16df-41ed-8ef7-db25fe0f4e05 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:28.708292 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e656a733-16df-41ed-8ef7-db25fe0f4e05 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:28.709580 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e656a733-16df-41ed-8ef7-db25fe0f4e05 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:28.710337 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e656a733-16df-41ed-8ef7-db25fe0f4e05 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:29.062710 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e656a733-16df-41ed-8ef7-db25fe0f4e05 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:29.073906 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e656a733-16df-41ed-8ef7-db25fe0f4e05 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1722 microversion: 2.1 time: 0.384220 Feb 28 19:05:29.074661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 236/468] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:28 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:29.229998 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a7b5418a-5abd-4069-b409-9ee28de4dc85 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:29.230591 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a7b5418a-5abd-4069-b409-9ee28de4dc85 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:29.240443 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7b5418a-5abd-4069-b409-9ee28de4dc85 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:29.241144 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7b5418a-5abd-4069-b409-9ee28de4dc85 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:29.242813 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7b5418a-5abd-4069-b409-9ee28de4dc85 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:29.243259 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7b5418a-5abd-4069-b409-9ee28de4dc85 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:29.355098 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7b5418a-5abd-4069-b409-9ee28de4dc85 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:29.355613 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7b5418a-5abd-4069-b409-9ee28de4dc85 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:29.363554 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-a7b5418a-5abd-4069-b409-9ee28de4dc85 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lazy-loading 'fault' on Instance uuid fea77b98-2b78-485a-beab-edf47a4fcc72 {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:05:29.410002 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8c8cd454-9b0a-4c08-8612-426209accf5a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:29.413225 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8c8cd454-9b0a-4c08-8612-426209accf5a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:29.424851 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8cd454-9b0a-4c08-8612-426209accf5a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:29.437470 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a7b5418a-5abd-4069-b409-9ee28de4dc85 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:29.441783 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8cd454-9b0a-4c08-8612-426209accf5a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:29.442996 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8cd454-9b0a-4c08-8612-426209accf5a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:29.443744 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8c8cd454-9b0a-4c08-8612-426209accf5a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:29.449699 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a7b5418a-5abd-4069-b409-9ee28de4dc85 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 200 len: 1306 microversion: 2.1 time: 0.223947 Feb 28 19:05:29.450857 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 233/469] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:29 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 1306 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:29.736061 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8c8cd454-9b0a-4c08-8612-426209accf5a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:29.745552 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8c8cd454-9b0a-4c08-8612-426209accf5a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:29.747182 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8c8cd454-9b0a-4c08-8612-426209accf5a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:29.748449 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8c8cd454-9b0a-4c08-8612-426209accf5a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.342417 Feb 28 19:05:29.749187 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 237/470] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:29 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:05:30.093473 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a30e23cb-8d78-4d3c-b4d4-ee4aef6ef8aa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:30.094087 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a30e23cb-8d78-4d3c-b4d4-ee4aef6ef8aa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:30.104386 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a30e23cb-8d78-4d3c-b4d4-ee4aef6ef8aa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:30.105768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a30e23cb-8d78-4d3c-b4d4-ee4aef6ef8aa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:30.107451 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a30e23cb-8d78-4d3c-b4d4-ee4aef6ef8aa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:30.108624 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a30e23cb-8d78-4d3c-b4d4-ee4aef6ef8aa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:30.388176 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a30e23cb-8d78-4d3c-b4d4-ee4aef6ef8aa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:30.397029 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a30e23cb-8d78-4d3c-b4d4-ee4aef6ef8aa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1722 microversion: 2.1 time: 0.307567 Feb 28 19:05:30.398366 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 234/471] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:30 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:05:30.472180 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f97cc254-1361-4fa1-8ca0-bd269b401ea3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:30.473040 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f97cc254-1361-4fa1-8ca0-bd269b401ea3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: fea77b98-2b78-485a-beab-edf47a4fcc72] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:30.481886 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f97cc254-1361-4fa1-8ca0-bd269b401ea3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:30.482569 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f97cc254-1361-4fa1-8ca0-bd269b401ea3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:30.483583 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f97cc254-1361-4fa1-8ca0-bd269b401ea3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:30.484030 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f97cc254-1361-4fa1-8ca0-bd269b401ea3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:30.536237 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-f97cc254-1361-4fa1-8ca0-bd269b401ea3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] HTTP exception thrown: Instance fea77b98-2b78-485a-beab-edf47a4fcc72 could not be found. Feb 28 19:05:30.536867 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f97cc254-1361-4fa1-8ca0-bd269b401ea3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Returning 404 to user: Instance fea77b98-2b78-485a-beab-edf47a4fcc72 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:30.537693 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f97cc254-1361-4fa1-8ca0-bd269b401ea3 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72" status: 404 len: 111 microversion: 2.1 time: 0.069471 Feb 28 19:05:30.538261 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 235/472] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:30 2022] GET /compute/v2.1/servers/fea77b98-2b78-485a-beab-edf47a4fcc72 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:05:30.547032 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a13c3b96-f1b7-471d-aa07-37aa09dec24d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:30.547867 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a13c3b96-f1b7-471d-aa07-37aa09dec24d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:30.556105 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a13c3b96-f1b7-471d-aa07-37aa09dec24d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:30.556480 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a13c3b96-f1b7-471d-aa07-37aa09dec24d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:30.557417 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a13c3b96-f1b7-471d-aa07-37aa09dec24d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:30.557862 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a13c3b96-f1b7-471d-aa07-37aa09dec24d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:30.626278 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a13c3b96-f1b7-471d-aa07-37aa09dec24d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Going to try to terminate instance {{(pid=101792) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:05:30.664629 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cddc4be1-2ecc-4732-8fd2-ae6f8470256e tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Action: 'create', calling method: .version_select at 0x7f912e66a3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-335086974", "metadata": {"Type": "work"}}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:30.666809 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cddc4be1-2ecc-4732-8fd2-ae6f8470256e tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:30.667772 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-cddc4be1-2ecc-4732-8fd2-ae6f8470256e tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.211934 Feb 28 19:05:30.668406 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 238/473] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Feb 28 19:05:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 28 19:05:30.682804 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-61acc475-7f5e-403e-8e12-65c64cbf274b tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Action: 'create', calling method: .version_select at 0x7f912e411670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1472158981", "metadata": {"Type": "work"}}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:30.684715 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-61acc475-7f5e-403e-8e12-65c64cbf274b tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:30.685751 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-61acc475-7f5e-403e-8e12-65c64cbf274b tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010001 Feb 28 19:05:30.686624 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 239/474] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Feb 28 19:05:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 28 19:05:30.698694 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-3f5e6761-792c-42e9-b46a-666429cd59a3 tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Action: 'create', calling method: .version_select at 0x7f912f7164c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-710206884", "metadata": {"Type": "work"}}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:30.700127 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-3f5e6761-792c-42e9-b46a-666429cd59a3 tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:30.701082 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-3f5e6761-792c-42e9-b46a-666429cd59a3 tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007264 Feb 28 19:05:30.702016 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 240/475] 10.222.0.21 () {60 vars in 1155 bytes} [Mon Feb 28 19:05:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 28 19:05:30.712575 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-73a43f0c-4663-4a8c-8a44-76c3ab7fe62b tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Calling method '.version_select at 0x7f912e66ad30>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:30.781215 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-73a43f0c-4663-4a8c-8a44-76c3ab7fe62b tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] HTTP exception thrown: Volume tempest-invalid-1303993930 could not be found. Feb 28 19:05:30.782488 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-73a43f0c-4663-4a8c-8a44-76c3ab7fe62b tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Returning 404 to user: Volume tempest-invalid-1303993930 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:30.783368 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-73a43f0c-4663-4a8c-8a44-76c3ab7fe62b tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1303993930" status: 404 len: 99 microversion: 2.1 time: 0.075277 Feb 28 19:05:30.783906 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 241/476] 10.222.0.21 () {58 vars in 1217 bytes} [Mon Feb 28 19:05:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1303993930 => generated 99 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 28 19:05:30.793272 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5b72362a-5dea-45a7-9b89-c46c99a4c21b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:30.793879 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5b72362a-5dea-45a7-9b89-c46c99a4c21b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:30.801419 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5b72362a-5dea-45a7-9b89-c46c99a4c21b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:30.802010 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5b72362a-5dea-45a7-9b89-c46c99a4c21b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:30.802812 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5b72362a-5dea-45a7-9b89-c46c99a4c21b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:30.803290 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5b72362a-5dea-45a7-9b89-c46c99a4c21b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:30.961902 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a13c3b96-f1b7-471d-aa07-37aa09dec24d tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "DELETE /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 204 len: 0 microversion: 2.1 time: 0.417834 Feb 28 19:05:30.963011 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 236/477] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:05:30 2022] DELETE /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 28 19:05:30.969506 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-dc8c3aa6-4231-4fa6-a053-df8d4d1c2fc3 tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005109 Feb 28 19:05:30.973819 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 237/478] 10.222.0.21 () {58 vars in 1139 bytes} [Mon Feb 28 19:05:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 28 19:05:30.991654 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-decd5a27-43a8-42da-9497-cd76f1de1dea tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:30.993115 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-decd5a27-43a8-42da-9497-cd76f1de1dea tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:31.015834 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-decd5a27-43a8-42da-9497-cd76f1de1dea tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:31.016403 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-decd5a27-43a8-42da-9497-cd76f1de1dea tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:31.017784 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-decd5a27-43a8-42da-9497-cd76f1de1dea tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:31.018670 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-decd5a27-43a8-42da-9497-cd76f1de1dea tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:31.065846 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5b72362a-5dea-45a7-9b89-c46c99a4c21b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:31.078518 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5b72362a-5dea-45a7-9b89-c46c99a4c21b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:31.080791 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5b72362a-5dea-45a7-9b89-c46c99a4c21b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:31.082216 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5b72362a-5dea-45a7-9b89-c46c99a4c21b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.297386 Feb 28 19:05:31.094602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 242/479] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:30 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:31.103769 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-3f82c836-2f58-454d-bf38-6e6ee1af4135 tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007703 Feb 28 19:05:31.104547 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 243/480] 10.222.0.21 () {58 vars in 1136 bytes} [Mon Feb 28 19:05:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 28 19:05:31.115091 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a3befaa4-579e-457e-9c92-25de51a3c52d tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Calling method '.version_select at 0x7f912e66a040>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:31.184160 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-a3befaa4-579e-457e-9c92-25de51a3c52d tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] HTTP exception thrown: Volume dfbe6a4d-f1c8-4ce1-bedc-0043a5940d1a could not be found. Feb 28 19:05:31.184787 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a3befaa4-579e-457e-9c92-25de51a3c52d tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Returning 404 to user: Volume dfbe6a4d-f1c8-4ce1-bedc-0043a5940d1a could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:31.185808 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a3befaa4-579e-457e-9c92-25de51a3c52d tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/dfbe6a4d-f1c8-4ce1-bedc-0043a5940d1a" status: 404 len: 109 microversion: 2.1 time: 0.074467 Feb 28 19:05:31.186780 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 244/481] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 19:05:31 2022] DELETE /compute/v2.1/os-volumes/dfbe6a4d-f1c8-4ce1-bedc-0043a5940d1a => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 19:05:31.195782 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-770eb6e0-aeda-4ece-b6de-dc4299af48dc tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Calling method '.version_select at 0x7f912e4d1940>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:31.291883 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-decd5a27-43a8-42da-9497-cd76f1de1dea tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:31.307771 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-770eb6e0-aeda-4ece-b6de-dc4299af48dc tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] HTTP exception thrown: Volume 7acea7b9-77b1-4756-8f25-ba77e4470dee could not be found. Feb 28 19:05:31.308586 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-770eb6e0-aeda-4ece-b6de-dc4299af48dc tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] Returning 404 to user: Volume 7acea7b9-77b1-4756-8f25-ba77e4470dee could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:31.309671 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-770eb6e0-aeda-4ece-b6de-dc4299af48dc tempest-VolumesNegativeTest-136875644 tempest-VolumesNegativeTest-136875644-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/7acea7b9-77b1-4756-8f25-ba77e4470dee" status: 404 len: 109 microversion: 2.1 time: 0.117696 Feb 28 19:05:31.310213 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 245/482] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:05:31 2022] GET /compute/v2.1/os-volumes/7acea7b9-77b1-4756-8f25-ba77e4470dee => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 19:05:31.317128 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-decd5a27-43a8-42da-9497-cd76f1de1dea tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1512 microversion: 2.1 time: 0.339457 Feb 28 19:05:31.318092 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 238/483] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:30 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:31.415317 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f71862e9-e4ee-454e-8792-a98654e6e2ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:31.415958 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f71862e9-e4ee-454e-8792-a98654e6e2ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:31.423652 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f71862e9-e4ee-454e-8792-a98654e6e2ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:31.424106 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f71862e9-e4ee-454e-8792-a98654e6e2ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:31.424928 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f71862e9-e4ee-454e-8792-a98654e6e2ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:31.425408 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f71862e9-e4ee-454e-8792-a98654e6e2ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:31.770078 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f71862e9-e4ee-454e-8792-a98654e6e2ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:31.780178 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f71862e9-e4ee-454e-8792-a98654e6e2ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1722 microversion: 2.1 time: 0.368494 Feb 28 19:05:31.791719 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 246/484] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:31 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1722 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:32.104346 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-80c796c6-886d-4c88-9018-b67e9d7c457a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:32.105657 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-80c796c6-886d-4c88-9018-b67e9d7c457a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:32.115983 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-80c796c6-886d-4c88-9018-b67e9d7c457a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:32.117502 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-80c796c6-886d-4c88-9018-b67e9d7c457a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:32.118611 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-80c796c6-886d-4c88-9018-b67e9d7c457a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:32.119250 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-80c796c6-886d-4c88-9018-b67e9d7c457a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:32.334804 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-599cae3e-a1fa-4cf0-b68e-967b7cdc4cbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:32.336041 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-599cae3e-a1fa-4cf0-b68e-967b7cdc4cbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:32.352598 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-599cae3e-a1fa-4cf0-b68e-967b7cdc4cbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:32.353389 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-599cae3e-a1fa-4cf0-b68e-967b7cdc4cbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:32.355916 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-599cae3e-a1fa-4cf0-b68e-967b7cdc4cbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:32.361000 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-599cae3e-a1fa-4cf0-b68e-967b7cdc4cbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:32.399947 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-80c796c6-886d-4c88-9018-b67e9d7c457a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:32.418533 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-80c796c6-886d-4c88-9018-b67e9d7c457a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:32.420418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-80c796c6-886d-4c88-9018-b67e9d7c457a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:32.421811 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-80c796c6-886d-4c88-9018-b67e9d7c457a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.324216 Feb 28 19:05:32.422903 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 239/485] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:32 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:32.645495 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-599cae3e-a1fa-4cf0-b68e-967b7cdc4cbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:32.656003 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-599cae3e-a1fa-4cf0-b68e-967b7cdc4cbe tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1512 microversion: 2.1 time: 0.325110 Feb 28 19:05:32.656812 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 247/486] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:32 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:05:32.800865 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4cf66754-02d0-4cdb-920d-5f43731af595 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:32.803906 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4cf66754-02d0-4cdb-920d-5f43731af595 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:32.817324 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4cf66754-02d0-4cdb-920d-5f43731af595 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:32.818228 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4cf66754-02d0-4cdb-920d-5f43731af595 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:32.819480 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4cf66754-02d0-4cdb-920d-5f43731af595 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:32.820876 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4cf66754-02d0-4cdb-920d-5f43731af595 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:33.164831 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4cf66754-02d0-4cdb-920d-5f43731af595 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:33.174589 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4cf66754-02d0-4cdb-920d-5f43731af595 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1722 microversion: 2.1 time: 0.379592 Feb 28 19:05:33.175211 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 240/487] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:32 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1722 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:05:33.443691 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-37960833-6d33-4926-9e47-d8d1496b1816 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:33.446241 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-37960833-6d33-4926-9e47-d8d1496b1816 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:33.455553 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-37960833-6d33-4926-9e47-d8d1496b1816 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:33.456311 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-37960833-6d33-4926-9e47-d8d1496b1816 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:33.457143 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-37960833-6d33-4926-9e47-d8d1496b1816 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:33.457908 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-37960833-6d33-4926-9e47-d8d1496b1816 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:33.674511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1626bba2-da8c-4007-9bc3-4912939e1b6e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:33.675502 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1626bba2-da8c-4007-9bc3-4912939e1b6e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:33.711539 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1626bba2-da8c-4007-9bc3-4912939e1b6e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:33.712450 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1626bba2-da8c-4007-9bc3-4912939e1b6e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:33.714266 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1626bba2-da8c-4007-9bc3-4912939e1b6e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:33.715636 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1626bba2-da8c-4007-9bc3-4912939e1b6e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:33.948342 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-37960833-6d33-4926-9e47-d8d1496b1816 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:33.957197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-37960833-6d33-4926-9e47-d8d1496b1816 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:33.958713 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-37960833-6d33-4926-9e47-d8d1496b1816 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:33.959883 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-37960833-6d33-4926-9e47-d8d1496b1816 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1747 microversion: 2.20 time: 0.520374 Feb 28 19:05:33.971368 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 248/488] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:33 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1747 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:05:34.096431 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1626bba2-da8c-4007-9bc3-4912939e1b6e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:34.105046 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1626bba2-da8c-4007-9bc3-4912939e1b6e tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1512 microversion: 2.1 time: 0.434882 Feb 28 19:05:34.114471 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 241/489] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:33 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:05:34.193665 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-35f7883a-cb8d-4b5f-acca-523be3bcf465 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:34.194434 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-35f7883a-cb8d-4b5f-acca-523be3bcf465 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:34.202250 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-35f7883a-cb8d-4b5f-acca-523be3bcf465 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:34.202906 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-35f7883a-cb8d-4b5f-acca-523be3bcf465 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:34.203845 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-35f7883a-cb8d-4b5f-acca-523be3bcf465 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:34.204268 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-35f7883a-cb8d-4b5f-acca-523be3bcf465 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:34.439224 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-35f7883a-cb8d-4b5f-acca-523be3bcf465 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:34.449730 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-35f7883a-cb8d-4b5f-acca-523be3bcf465 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1722 microversion: 2.1 time: 0.260673 Feb 28 19:05:34.451360 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 249/490] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:34 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:34.907380 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-66b38415-716e-4eca-afad-cede54493094 req-e1e55abb-c87c-41df-89b4-94a52e6d0498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83758134-d6d4-4bf6-bdb6-f00ef16501ff", "name": "network-vif-deleted", "tag": "f3587eff-27f1-497f-89ad-a020d585a895"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:34.910801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:05:34.910801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:05:34.942161 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-66b38415-716e-4eca-afad-cede54493094 req-e1e55abb-c87c-41df-89b4-94a52e6d0498 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:34.945540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-66b38415-716e-4eca-afad-cede54493094 req-e1e55abb-c87c-41df-89b4-94a52e6d0498 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:34.965606 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-66b38415-716e-4eca-afad-cede54493094 req-e1e55abb-c87c-41df-89b4-94a52e6d0498 service nova] Creating event network-vif-deleted:f3587eff-27f1-497f-89ad-a020d585a895 for instance 83758134-d6d4-4bf6-bdb6-f00ef16501ff on hv-cinder-83118 Feb 28 19:05:34.970957 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-66b38415-716e-4eca-afad-cede54493094 req-e1e55abb-c87c-41df-89b4-94a52e6d0498 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068105 Feb 28 19:05:34.974111 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 242/491] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:05:34.979744 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9ea063e5-6946-4c2a-865a-2aff090e02df tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:34.983760 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9ea063e5-6946-4c2a-865a-2aff090e02df tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:34.994983 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ea063e5-6946-4c2a-865a-2aff090e02df tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:34.996630 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ea063e5-6946-4c2a-865a-2aff090e02df tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:34.997595 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ea063e5-6946-4c2a-865a-2aff090e02df tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:34.998822 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ea063e5-6946-4c2a-865a-2aff090e02df tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:35.131272 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2ca6822c-80ba-4217-b5b9-42d6d46d1eb6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:35.132381 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2ca6822c-80ba-4217-b5b9-42d6d46d1eb6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:35.151083 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2ca6822c-80ba-4217-b5b9-42d6d46d1eb6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:35.151696 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2ca6822c-80ba-4217-b5b9-42d6d46d1eb6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:35.152685 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2ca6822c-80ba-4217-b5b9-42d6d46d1eb6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:35.153424 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2ca6822c-80ba-4217-b5b9-42d6d46d1eb6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:35.253519 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9ea063e5-6946-4c2a-865a-2aff090e02df tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:35.263406 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9ea063e5-6946-4c2a-865a-2aff090e02df tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:35.264916 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9ea063e5-6946-4c2a-865a-2aff090e02df tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:35.266084 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9ea063e5-6946-4c2a-865a-2aff090e02df tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1747 microversion: 2.20 time: 0.290297 Feb 28 19:05:35.266749 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 250/492] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:34 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1747 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:35.313556 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2ca6822c-80ba-4217-b5b9-42d6d46d1eb6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:35.321751 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2ca6822c-80ba-4217-b5b9-42d6d46d1eb6 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 200 len: 1302 microversion: 2.1 time: 0.202042 Feb 28 19:05:35.322300 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 243/493] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:35 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 1302 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:35.467254 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-246ff361-bef4-4dc2-b83a-8bdbb08e72c7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:35.467866 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-246ff361-bef4-4dc2-b83a-8bdbb08e72c7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:35.475409 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-246ff361-bef4-4dc2-b83a-8bdbb08e72c7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:35.476485 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-246ff361-bef4-4dc2-b83a-8bdbb08e72c7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:35.477264 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-246ff361-bef4-4dc2-b83a-8bdbb08e72c7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:35.477700 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-246ff361-bef4-4dc2-b83a-8bdbb08e72c7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:35.677068 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-246ff361-bef4-4dc2-b83a-8bdbb08e72c7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:35.706734 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-246ff361-bef4-4dc2-b83a-8bdbb08e72c7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1722 microversion: 2.1 time: 0.243106 Feb 28 19:05:35.707467 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 251/494] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:35 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:36.285483 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-845481dd-c840-42cf-a4a0-6dd393a8677f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:36.286150 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-845481dd-c840-42cf-a4a0-6dd393a8677f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:36.295381 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-845481dd-c840-42cf-a4a0-6dd393a8677f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:36.296972 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-845481dd-c840-42cf-a4a0-6dd393a8677f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:36.297765 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-845481dd-c840-42cf-a4a0-6dd393a8677f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:36.298206 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-845481dd-c840-42cf-a4a0-6dd393a8677f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:36.337760 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cc33f9ea-e98b-4d27-84c1-05b1ff4f99ff tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:36.338377 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-cc33f9ea-e98b-4d27-84c1-05b1ff4f99ff tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 83758134-d6d4-4bf6-bdb6-f00ef16501ff] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:36.347578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cc33f9ea-e98b-4d27-84c1-05b1ff4f99ff tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:36.348287 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cc33f9ea-e98b-4d27-84c1-05b1ff4f99ff tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:36.349242 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cc33f9ea-e98b-4d27-84c1-05b1ff4f99ff tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:36.349887 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cc33f9ea-e98b-4d27-84c1-05b1ff4f99ff tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:36.413771 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-cc33f9ea-e98b-4d27-84c1-05b1ff4f99ff tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] HTTP exception thrown: Instance 83758134-d6d4-4bf6-bdb6-f00ef16501ff could not be found. Feb 28 19:05:36.414685 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cc33f9ea-e98b-4d27-84c1-05b1ff4f99ff tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Returning 404 to user: Instance 83758134-d6d4-4bf6-bdb6-f00ef16501ff could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:36.415722 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-cc33f9ea-e98b-4d27-84c1-05b1ff4f99ff tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff" status: 404 len: 111 microversion: 2.1 time: 0.081929 Feb 28 19:05:36.416996 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 252/495] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:36 2022] GET /compute/v2.1/servers/83758134-d6d4-4bf6-bdb6-f00ef16501ff => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 19:05:36.559019 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-6c45b5cb-ce43-4453-b225-a1074d273ab5 req-557b8471-b022-4b59-be64-a8c915ec3c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70", "name": "network-vif-plugged", "status": "completed", "tag": "7caa3a37-72ae-4e36-90cf-0f518cb19c37"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:36.559019 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:05:36.559019 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:05:36.562680 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-845481dd-c840-42cf-a4a0-6dd393a8677f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:36.567920 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-6c45b5cb-ce43-4453-b225-a1074d273ab5 req-557b8471-b022-4b59-be64-a8c915ec3c82 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:36.568474 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-6c45b5cb-ce43-4453-b225-a1074d273ab5 req-557b8471-b022-4b59-be64-a8c915ec3c82 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:36.572360 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-845481dd-c840-42cf-a4a0-6dd393a8677f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:36.574120 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-845481dd-c840-42cf-a4a0-6dd393a8677f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:36.575538 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-845481dd-c840-42cf-a4a0-6dd393a8677f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1747 microversion: 2.20 time: 0.294287 Feb 28 19:05:36.576115 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 244/496] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:36 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1747 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:36.591969 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-6c45b5cb-ce43-4453-b225-a1074d273ab5 req-557b8471-b022-4b59-be64-a8c915ec3c82 service nova] Creating event network-vif-plugged:7caa3a37-72ae-4e36-90cf-0f518cb19c37 for instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 on hv-cinder-83118 Feb 28 19:05:36.596852 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-6c45b5cb-ce43-4453-b225-a1074d273ab5 req-557b8471-b022-4b59-be64-a8c915ec3c82 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047307 Feb 28 19:05:36.598907 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 253/497] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:05:36.725084 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0d294361-0cbf-46f6-9053-2a1fe28b09c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:36.725728 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0d294361-0cbf-46f6-9053-2a1fe28b09c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:36.733032 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0d294361-0cbf-46f6-9053-2a1fe28b09c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:36.733470 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0d294361-0cbf-46f6-9053-2a1fe28b09c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:36.734260 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0d294361-0cbf-46f6-9053-2a1fe28b09c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:36.734687 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0d294361-0cbf-46f6-9053-2a1fe28b09c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:36.991409 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0d294361-0cbf-46f6-9053-2a1fe28b09c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:37.002033 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0d294361-0cbf-46f6-9053-2a1fe28b09c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1722 microversion: 2.1 time: 0.280583 Feb 28 19:05:37.003573 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 245/498] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:36 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:37.594445 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ed94909a-2290-4b88-9a2e-3b79b6565d7a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:37.595239 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ed94909a-2290-4b88-9a2e-3b79b6565d7a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:37.602794 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ed94909a-2290-4b88-9a2e-3b79b6565d7a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:37.603284 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ed94909a-2290-4b88-9a2e-3b79b6565d7a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:37.604063 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ed94909a-2290-4b88-9a2e-3b79b6565d7a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:37.604498 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ed94909a-2290-4b88-9a2e-3b79b6565d7a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:37.833597 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ed94909a-2290-4b88-9a2e-3b79b6565d7a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:37.844539 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ed94909a-2290-4b88-9a2e-3b79b6565d7a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:37.846126 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ed94909a-2290-4b88-9a2e-3b79b6565d7a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:37.847376 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ed94909a-2290-4b88-9a2e-3b79b6565d7a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1747 microversion: 2.20 time: 0.257108 Feb 28 19:05:37.847997 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 254/499] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:37 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1747 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:05:38.019541 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9cc62736-d039-44c2-ad63-41a8bd16811a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:38.020176 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9cc62736-d039-44c2-ad63-41a8bd16811a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:38.027544 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9cc62736-d039-44c2-ad63-41a8bd16811a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:38.028134 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9cc62736-d039-44c2-ad63-41a8bd16811a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:38.028994 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9cc62736-d039-44c2-ad63-41a8bd16811a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:38.029494 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9cc62736-d039-44c2-ad63-41a8bd16811a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:38.251871 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9cc62736-d039-44c2-ad63-41a8bd16811a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:38.261062 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9cc62736-d039-44c2-ad63-41a8bd16811a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1722 microversion: 2.1 time: 0.245198 Feb 28 19:05:38.261689 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 246/500] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:38 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:38.866198 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5271791f-21a8-41a4-88a9-8d9d5edd983b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:38.867523 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5271791f-21a8-41a4-88a9-8d9d5edd983b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:38.874693 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5271791f-21a8-41a4-88a9-8d9d5edd983b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:38.875173 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5271791f-21a8-41a4-88a9-8d9d5edd983b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:38.875950 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5271791f-21a8-41a4-88a9-8d9d5edd983b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:38.876385 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5271791f-21a8-41a4-88a9-8d9d5edd983b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:39.086665 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5271791f-21a8-41a4-88a9-8d9d5edd983b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:39.095528 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5271791f-21a8-41a4-88a9-8d9d5edd983b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:39.097030 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5271791f-21a8-41a4-88a9-8d9d5edd983b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:39.098150 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5271791f-21a8-41a4-88a9-8d9d5edd983b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1747 microversion: 2.20 time: 0.235775 Feb 28 19:05:39.098732 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 255/501] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:38 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1747 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:39.277947 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a5987479-20e6-4adf-842f-64646ed6a44f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:39.278549 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a5987479-20e6-4adf-842f-64646ed6a44f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:39.285823 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a5987479-20e6-4adf-842f-64646ed6a44f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:39.293839 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a5987479-20e6-4adf-842f-64646ed6a44f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:39.293839 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a5987479-20e6-4adf-842f-64646ed6a44f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:39.293839 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a5987479-20e6-4adf-842f-64646ed6a44f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:39.490116 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a5987479-20e6-4adf-842f-64646ed6a44f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:39.500980 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a5987479-20e6-4adf-842f-64646ed6a44f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1722 microversion: 2.1 time: 0.226687 Feb 28 19:05:39.501663 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 247/502] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:39 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:40.116973 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-45a5f9db-3724-4203-b356-89478e7882db tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:40.117549 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-45a5f9db-3724-4203-b356-89478e7882db tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:40.124943 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-45a5f9db-3724-4203-b356-89478e7882db tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:40.125385 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-45a5f9db-3724-4203-b356-89478e7882db tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:40.126181 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-45a5f9db-3724-4203-b356-89478e7882db tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:40.126706 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-45a5f9db-3724-4203-b356-89478e7882db tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:40.222783 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-87ab911f-fa3e-4963-acc6-2cf12207ae34 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:40.224614 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-87ab911f-fa3e-4963-acc6-2cf12207ae34 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:40.239132 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-87ab911f-fa3e-4963-acc6-2cf12207ae34 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:40.239863 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-87ab911f-fa3e-4963-acc6-2cf12207ae34 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:40.241137 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-87ab911f-fa3e-4963-acc6-2cf12207ae34 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:40.242757 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-87ab911f-fa3e-4963-acc6-2cf12207ae34 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:40.319796 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-87ab911f-fa3e-4963-acc6-2cf12207ae34 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Going to try to terminate instance {{(pid=101792) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:05:40.365685 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-45a5f9db-3724-4203-b356-89478e7882db tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:40.389227 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-45a5f9db-3724-4203-b356-89478e7882db tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:40.396122 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-45a5f9db-3724-4203-b356-89478e7882db tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:40.399713 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-45a5f9db-3724-4203-b356-89478e7882db tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1747 microversion: 2.20 time: 0.286471 Feb 28 19:05:40.400279 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 256/503] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:40 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1747 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:40.517597 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a4aaf5ba-da6e-4844-af28-9803e9a02c29 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:40.518205 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a4aaf5ba-da6e-4844-af28-9803e9a02c29 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:40.526084 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a4aaf5ba-da6e-4844-af28-9803e9a02c29 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:40.526535 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a4aaf5ba-da6e-4844-af28-9803e9a02c29 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:40.527353 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a4aaf5ba-da6e-4844-af28-9803e9a02c29 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:40.527786 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a4aaf5ba-da6e-4844-af28-9803e9a02c29 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:40.722098 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-87ab911f-fa3e-4963-acc6-2cf12207ae34 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "DELETE /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 204 len: 0 microversion: 2.1 time: 0.506062 Feb 28 19:05:40.722701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 248/504] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:05:40 2022] DELETE /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 28 19:05:40.732332 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7a05eb0e-f3a6-4bab-9db5-a049b2f119a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:40.733224 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7a05eb0e-f3a6-4bab-9db5-a049b2f119a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:40.746511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7a05eb0e-f3a6-4bab-9db5-a049b2f119a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:40.754770 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7a05eb0e-f3a6-4bab-9db5-a049b2f119a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:40.755832 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7a05eb0e-f3a6-4bab-9db5-a049b2f119a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:40.756373 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7a05eb0e-f3a6-4bab-9db5-a049b2f119a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:40.789726 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a4aaf5ba-da6e-4844-af28-9803e9a02c29 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:40.803334 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a4aaf5ba-da6e-4844-af28-9803e9a02c29 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1699 microversion: 2.1 time: 0.289322 Feb 28 19:05:40.807232 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 257/505] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:40 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1699 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:05:40.821748 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9225b39a-08bd-4d81-ad40-8903bc979bbe tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:40.830401 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9225b39a-08bd-4d81-ad40-8903bc979bbe tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:40.830879 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9225b39a-08bd-4d81-ad40-8903bc979bbe tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:40.898975 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9225b39a-08bd-4d81-ad40-8903bc979bbe tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Going to try to start instance {{(pid=101791) start /opt/stack/nova/nova/compute/api.py:2625}} Feb 28 19:05:41.160246 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9225b39a-08bd-4d81-ad40-8903bc979bbe tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "POST /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/action" status: 202 len: 0 microversion: 2.1 time: 0.341934 Feb 28 19:05:41.162020 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 258/506] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:05:40 2022] POST /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:05:41.185313 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7f3f4517-d52a-4bac-b35c-267fd2aeb738 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:41.186468 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7f3f4517-d52a-4bac-b35c-267fd2aeb738 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:41.198104 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7f3f4517-d52a-4bac-b35c-267fd2aeb738 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:41.198944 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7f3f4517-d52a-4bac-b35c-267fd2aeb738 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:41.199833 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7f3f4517-d52a-4bac-b35c-267fd2aeb738 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:41.200365 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7f3f4517-d52a-4bac-b35c-267fd2aeb738 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:41.508768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7a05eb0e-f3a6-4bab-9db5-a049b2f119a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:41.520307 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7a05eb0e-f3a6-4bab-9db5-a049b2f119a2 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1513 microversion: 2.1 time: 0.792382 Feb 28 19:05:41.521541 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 249/507] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:40 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1513 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:41.527926 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6873a1c3-4eeb-45e2-96c3-0de65885a3be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:41.528858 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6873a1c3-4eeb-45e2-96c3-0de65885a3be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:41.536367 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6873a1c3-4eeb-45e2-96c3-0de65885a3be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:41.537234 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6873a1c3-4eeb-45e2-96c3-0de65885a3be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:41.538192 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6873a1c3-4eeb-45e2-96c3-0de65885a3be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:41.538790 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6873a1c3-4eeb-45e2-96c3-0de65885a3be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:41.693226 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7f3f4517-d52a-4bac-b35c-267fd2aeb738 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:41.705996 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7f3f4517-d52a-4bac-b35c-267fd2aeb738 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1708 microversion: 2.1 time: 0.528452 Feb 28 19:05:41.706943 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 259/508] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:41 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1708 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:41.917788 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6873a1c3-4eeb-45e2-96c3-0de65885a3be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:41.932828 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6873a1c3-4eeb-45e2-96c3-0de65885a3be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:41.934608 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6873a1c3-4eeb-45e2-96c3-0de65885a3be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:41.940035 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6873a1c3-4eeb-45e2-96c3-0de65885a3be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.417212 Feb 28 19:05:41.941209 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 250/509] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:41 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:42.541981 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-982fad55-5d81-40dc-8727-6db57f064cfd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:42.543395 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-982fad55-5d81-40dc-8727-6db57f064cfd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:42.557386 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-982fad55-5d81-40dc-8727-6db57f064cfd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:42.568197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-982fad55-5d81-40dc-8727-6db57f064cfd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:42.568197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-982fad55-5d81-40dc-8727-6db57f064cfd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:42.568197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-982fad55-5d81-40dc-8727-6db57f064cfd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:42.723640 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-28d2ad37-9247-4f88-a23e-a272d633deb7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:42.724252 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-28d2ad37-9247-4f88-a23e-a272d633deb7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:42.735689 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28d2ad37-9247-4f88-a23e-a272d633deb7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:42.736033 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28d2ad37-9247-4f88-a23e-a272d633deb7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:42.736811 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28d2ad37-9247-4f88-a23e-a272d633deb7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:42.737244 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28d2ad37-9247-4f88-a23e-a272d633deb7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:43.081368 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-982fad55-5d81-40dc-8727-6db57f064cfd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:43.096386 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-982fad55-5d81-40dc-8727-6db57f064cfd tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1513 microversion: 2.1 time: 0.559909 Feb 28 19:05:43.099032 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 260/510] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:42 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1513 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:43.122194 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-07542fa8-2ff2-499e-88d4-78838ba50ae9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:43.133226 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-07542fa8-2ff2-499e-88d4-78838ba50ae9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:43.154007 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-07542fa8-2ff2-499e-88d4-78838ba50ae9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:43.155333 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-07542fa8-2ff2-499e-88d4-78838ba50ae9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:43.163551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-07542fa8-2ff2-499e-88d4-78838ba50ae9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:43.163551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-07542fa8-2ff2-499e-88d4-78838ba50ae9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:43.265094 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-28d2ad37-9247-4f88-a23e-a272d633deb7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:43.279949 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-28d2ad37-9247-4f88-a23e-a272d633deb7 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1708 microversion: 2.1 time: 0.559751 Feb 28 19:05:43.281581 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 251/511] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:42 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1708 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:05:43.494159 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-07542fa8-2ff2-499e-88d4-78838ba50ae9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:43.510958 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-07542fa8-2ff2-499e-88d4-78838ba50ae9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:43.517146 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-07542fa8-2ff2-499e-88d4-78838ba50ae9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:43.533733 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-07542fa8-2ff2-499e-88d4-78838ba50ae9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.427315 Feb 28 19:05:43.536194 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 261/512] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:43 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:44.116140 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b71bd116-6a7f-4bf2-941a-e5450dcf6984 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:44.118114 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b71bd116-6a7f-4bf2-941a-e5450dcf6984 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:44.137432 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b71bd116-6a7f-4bf2-941a-e5450dcf6984 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:44.138589 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b71bd116-6a7f-4bf2-941a-e5450dcf6984 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:44.140936 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b71bd116-6a7f-4bf2-941a-e5450dcf6984 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:44.142838 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b71bd116-6a7f-4bf2-941a-e5450dcf6984 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:44.301853 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4267af30-0027-4698-8470-57c6d56b5d08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:44.303243 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4267af30-0027-4698-8470-57c6d56b5d08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:44.314905 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4267af30-0027-4698-8470-57c6d56b5d08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:44.315511 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4267af30-0027-4698-8470-57c6d56b5d08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:44.316541 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4267af30-0027-4698-8470-57c6d56b5d08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:44.317352 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4267af30-0027-4698-8470-57c6d56b5d08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:44.538666 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b71bd116-6a7f-4bf2-941a-e5450dcf6984 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:44.582539 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b71bd116-6a7f-4bf2-941a-e5450dcf6984 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1513 microversion: 2.1 time: 0.470297 Feb 28 19:05:44.591046 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 252/513] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:44 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1513 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:44.606156 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b759eef5-96bb-40df-943a-790b0a908b7b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:44.624359 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b759eef5-96bb-40df-943a-790b0a908b7b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:44.641981 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b759eef5-96bb-40df-943a-790b0a908b7b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:44.642415 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b759eef5-96bb-40df-943a-790b0a908b7b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:44.644328 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b759eef5-96bb-40df-943a-790b0a908b7b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:44.644780 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b759eef5-96bb-40df-943a-790b0a908b7b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:44.661783 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4267af30-0027-4698-8470-57c6d56b5d08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:44.675696 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4267af30-0027-4698-8470-57c6d56b5d08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1712 microversion: 2.1 time: 0.378685 Feb 28 19:05:44.696232 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 262/514] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:44 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1712 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:44.940753 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b759eef5-96bb-40df-943a-790b0a908b7b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:44.950143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b759eef5-96bb-40df-943a-790b0a908b7b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:44.952795 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b759eef5-96bb-40df-943a-790b0a908b7b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:44.953807 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b759eef5-96bb-40df-943a-790b0a908b7b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.361288 Feb 28 19:05:44.965729 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 253/515] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:44 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:44.986062 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-9429a51d-ee14-4b3d-a19f-2bee78fddff1 req-d3f18256-87c7-44ac-9dc6-560dde6e87ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d1ca96-68b1-4b7c-ac23-4b314f12cbb6", "name": "network-vif-deleted", "tag": "60d1f848-70b7-4bb1-b406-979cd526e704"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:44.987718 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:05:44.987718 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:05:44.998020 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-9429a51d-ee14-4b3d-a19f-2bee78fddff1 req-d3f18256-87c7-44ac-9dc6-560dde6e87ad service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:44.998862 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-9429a51d-ee14-4b3d-a19f-2bee78fddff1 req-d3f18256-87c7-44ac-9dc6-560dde6e87ad service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:45.018619 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-9429a51d-ee14-4b3d-a19f-2bee78fddff1 req-d3f18256-87c7-44ac-9dc6-560dde6e87ad service nova] Creating event network-vif-deleted:60d1f848-70b7-4bb1-b406-979cd526e704 for instance 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 on hv-cinder-83118 Feb 28 19:05:45.025316 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-9429a51d-ee14-4b3d-a19f-2bee78fddff1 req-d3f18256-87c7-44ac-9dc6-560dde6e87ad service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042957 Feb 28 19:05:45.026392 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 263/516] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:05:45.603956 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a54fafa0-ba96-4dfb-bcf8-ca9361728049 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:45.604973 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a54fafa0-ba96-4dfb-bcf8-ca9361728049 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:45.614356 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a54fafa0-ba96-4dfb-bcf8-ca9361728049 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:45.615219 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a54fafa0-ba96-4dfb-bcf8-ca9361728049 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:45.616477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a54fafa0-ba96-4dfb-bcf8-ca9361728049 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:45.617556 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a54fafa0-ba96-4dfb-bcf8-ca9361728049 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:45.713431 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a54fafa0-ba96-4dfb-bcf8-ca9361728049 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:45.713862 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a54fafa0-ba96-4dfb-bcf8-ca9361728049 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:45.714266 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-a54fafa0-ba96-4dfb-bcf8-ca9361728049 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lazy-loading 'fault' on Instance uuid 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:05:45.781803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a54fafa0-ba96-4dfb-bcf8-ca9361728049 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e767d2e3624a3fa799c8c1b20b0516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498eaf5c78e54296ac5cdeef3489e3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:45.792066 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a54fafa0-ba96-4dfb-bcf8-ca9361728049 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 200 len: 1308 microversion: 2.1 time: 0.192976 Feb 28 19:05:45.801675 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 254/517] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:45 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:05:45.972875 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9f84bdee-c220-4ba3-9f74-2e16b0a111ad tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:45.973487 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9f84bdee-c220-4ba3-9f74-2e16b0a111ad tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:45.981655 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9f84bdee-c220-4ba3-9f74-2e16b0a111ad tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:45.982100 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9f84bdee-c220-4ba3-9f74-2e16b0a111ad tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:45.982860 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9f84bdee-c220-4ba3-9f74-2e16b0a111ad tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:45.983340 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9f84bdee-c220-4ba3-9f74-2e16b0a111ad tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:46.178951 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9f84bdee-c220-4ba3-9f74-2e16b0a111ad tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:46.188733 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9f84bdee-c220-4ba3-9f74-2e16b0a111ad tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:46.190235 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9f84bdee-c220-4ba3-9f74-2e16b0a111ad tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:46.191550 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9f84bdee-c220-4ba3-9f74-2e16b0a111ad tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.222838 Feb 28 19:05:46.192109 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 264/518] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:45 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:46.810635 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-befaf633-9c6b-4556-823b-95519b268360 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:46.811786 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-befaf633-9c6b-4556-823b-95519b268360 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] [instance: 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:46.820457 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-befaf633-9c6b-4556-823b-95519b268360 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:46.821705 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-befaf633-9c6b-4556-823b-95519b268360 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:46.822538 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-befaf633-9c6b-4556-823b-95519b268360 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:46.822977 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-befaf633-9c6b-4556-823b-95519b268360 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:46.884179 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-befaf633-9c6b-4556-823b-95519b268360 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] HTTP exception thrown: Instance 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 could not be found. Feb 28 19:05:46.884803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-befaf633-9c6b-4556-823b-95519b268360 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] Returning 404 to user: Instance 95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:05:46.885641 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-befaf633-9c6b-4556-823b-95519b268360 tempest-AttachVolumeNegativeTest-1287121544 tempest-AttachVolumeNegativeTest-1287121544-project] 10.222.0.21 "GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6" status: 404 len: 111 microversion: 2.1 time: 0.079325 Feb 28 19:05:46.886207 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 255/519] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:05:46 2022] GET /compute/v2.1/servers/95d1ca96-68b1-4b7c-ac23-4b314f12cbb6 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:05:47.209534 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-fe218fcd-0c3c-4483-bdc6-d58e31c49043 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:47.210818 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-fe218fcd-0c3c-4483-bdc6-d58e31c49043 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:47.220350 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fe218fcd-0c3c-4483-bdc6-d58e31c49043 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:47.233378 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fe218fcd-0c3c-4483-bdc6-d58e31c49043 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:47.233378 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fe218fcd-0c3c-4483-bdc6-d58e31c49043 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:47.233378 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fe218fcd-0c3c-4483-bdc6-d58e31c49043 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:47.535669 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-fe218fcd-0c3c-4483-bdc6-d58e31c49043 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:47.554460 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-fe218fcd-0c3c-4483-bdc6-d58e31c49043 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:47.557467 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-fe218fcd-0c3c-4483-bdc6-d58e31c49043 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:47.559695 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-fe218fcd-0c3c-4483-bdc6-d58e31c49043 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.353695 Feb 28 19:05:47.571705 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 265/520] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:47 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:48.577613 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-30d2c876-721f-494c-bfbe-88bb82bf5460 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:48.579452 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-30d2c876-721f-494c-bfbe-88bb82bf5460 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:48.591397 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-30d2c876-721f-494c-bfbe-88bb82bf5460 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:48.592219 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-30d2c876-721f-494c-bfbe-88bb82bf5460 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:48.593418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-30d2c876-721f-494c-bfbe-88bb82bf5460 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:48.594577 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-30d2c876-721f-494c-bfbe-88bb82bf5460 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:48.845283 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-30d2c876-721f-494c-bfbe-88bb82bf5460 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:48.861936 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-30d2c876-721f-494c-bfbe-88bb82bf5460 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:48.870568 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-30d2c876-721f-494c-bfbe-88bb82bf5460 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:48.873929 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-30d2c876-721f-494c-bfbe-88bb82bf5460 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.299290 Feb 28 19:05:48.874970 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 256/521] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:48 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:49.894516 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d3f7f8e9-1c0e-4539-8810-0d750c440d23 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:49.895341 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d3f7f8e9-1c0e-4539-8810-0d750c440d23 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:49.905760 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3f7f8e9-1c0e-4539-8810-0d750c440d23 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:49.907310 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3f7f8e9-1c0e-4539-8810-0d750c440d23 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:49.908236 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3f7f8e9-1c0e-4539-8810-0d750c440d23 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:49.908905 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d3f7f8e9-1c0e-4539-8810-0d750c440d23 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:50.213377 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d3f7f8e9-1c0e-4539-8810-0d750c440d23 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:50.225988 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d3f7f8e9-1c0e-4539-8810-0d750c440d23 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:50.228614 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d3f7f8e9-1c0e-4539-8810-0d750c440d23 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:50.230311 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d3f7f8e9-1c0e-4539-8810-0d750c440d23 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.339301 Feb 28 19:05:50.240632 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 266/522] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:49 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:51.249196 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-23785194-3bcc-49de-9cf5-89a065a328aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:51.250484 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-23785194-3bcc-49de-9cf5-89a065a328aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:51.261699 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-23785194-3bcc-49de-9cf5-89a065a328aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:51.262256 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-23785194-3bcc-49de-9cf5-89a065a328aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:51.263436 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-23785194-3bcc-49de-9cf5-89a065a328aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:51.263699 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-23785194-3bcc-49de-9cf5-89a065a328aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:51.534140 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-23785194-3bcc-49de-9cf5-89a065a328aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:51.548547 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-23785194-3bcc-49de-9cf5-89a065a328aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:51.550855 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-23785194-3bcc-49de-9cf5-89a065a328aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:51.552196 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-23785194-3bcc-49de-9cf5-89a065a328aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.307604 Feb 28 19:05:51.564592 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 257/523] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:51 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:51.684707 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5e35f280-4215-46c8-97a7-8a61ddd86309 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Action: 'create', calling method: .version_select at 0x7f912e4d1af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1006268021"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:52.574528 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9c4aa178-e07a-4a8b-b72e-d8adb45840af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:52.575183 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9c4aa178-e07a-4a8b-b72e-d8adb45840af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:52.587627 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5e35f280-4215-46c8-97a7-8a61ddd86309 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.277187 Feb 28 19:05:52.588724 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 267/524] 10.222.0.21 () {60 vars in 1154 bytes} [Mon Feb 28 19:05:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1281 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 28 19:05:52.591472 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c4aa178-e07a-4a8b-b72e-d8adb45840af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:52.599656 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-226b4b9b-9953-4f3c-94ab-1792c340d8dd tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e411b80>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:52.603503 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c4aa178-e07a-4a8b-b72e-d8adb45840af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:52.607485 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c4aa178-e07a-4a8b-b72e-d8adb45840af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:52.607948 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c4aa178-e07a-4a8b-b72e-d8adb45840af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:52.755276 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-226b4b9b-9953-4f3c-94ab-1792c340d8dd tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184" status: 200 len: 345 microversion: 2.1 time: 0.159748 Feb 28 19:05:52.756090 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 268/525] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:05:52 2022] GET /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184 => generated 345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:05:52.928761 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9c4aa178-e07a-4a8b-b72e-d8adb45840af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:52.943345 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9c4aa178-e07a-4a8b-b72e-d8adb45840af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:52.949620 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9c4aa178-e07a-4a8b-b72e-d8adb45840af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:52.951499 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9c4aa178-e07a-4a8b-b72e-d8adb45840af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.381367 Feb 28 19:05:52.952542 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 258/526] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:52 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:05:53.767198 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4197a2d4-f7f8-4235-afc3-b52154500ad9 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e2c79d0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:53.857295 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4197a2d4-f7f8-4235-afc3-b52154500ad9 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184" status: 200 len: 346 microversion: 2.1 time: 0.094034 Feb 28 19:05:53.857879 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 269/527] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:05:53 2022] GET /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184 => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:53.870698 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b7c3c48a-ce2d-4604-9084-cf8e04d3d385 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Action: 'create', calling method: .version_select at 0x7f912e189c10>, body: {"snapshot": {"volume_id": "86828326-01c7-41f4-84f3-039631154184", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1765543468"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:05:53.970502 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d53fedce-4558-456c-a487-935d6e0f0863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:53.971534 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d53fedce-4558-456c-a487-935d6e0f0863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:53.981795 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d53fedce-4558-456c-a487-935d6e0f0863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:53.982907 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d53fedce-4558-456c-a487-935d6e0f0863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:53.984000 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d53fedce-4558-456c-a487-935d6e0f0863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:53.984668 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d53fedce-4558-456c-a487-935d6e0f0863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:54.199856 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d53fedce-4558-456c-a487-935d6e0f0863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:54.208711 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d53fedce-4558-456c-a487-935d6e0f0863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:54.210760 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d53fedce-4558-456c-a487-935d6e0f0863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:54.211904 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d53fedce-4558-456c-a487-935d6e0f0863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.246023 Feb 28 19:05:54.212456 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 270/528] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:53 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:05:54.666587 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b7c3c48a-ce2d-4604-9084-cf8e04d3d385 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.801035 Feb 28 19:05:54.667974 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 259/529] 10.222.0.21 () {60 vars in 1161 bytes} [Mon Feb 28 19:05:53 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:54.677041 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2b850f6e-5891-4e4b-bcca-690ebc584d10 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e40f040>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:54.753438 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2b850f6e-5891-4e4b-bcca-690ebc584d10 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff" status: 200 len: 287 microversion: 2.1 time: 0.079900 Feb 28 19:05:54.754394 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 271/530] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 19:05:54 2022] GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:54.764431 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ff467d9d-a371-4357-b027-be9df69eacf7 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e1a4940>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:54.821119 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ff467d9d-a371-4357-b027-be9df69eacf7 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.060244 Feb 28 19:05:54.821690 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 260/531] 10.222.0.21 () {58 vars in 1139 bytes} [Mon Feb 28 19:05:54 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:54.832299 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-58d028cb-a4ea-422a-ad34-ccf61f907053 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e40f700>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:54.896857 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-58d028cb-a4ea-422a-ad34-ccf61f907053 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff" status: 200 len: 287 microversion: 2.1 time: 0.069316 Feb 28 19:05:54.897413 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 272/532] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 19:05:54 2022] GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:55.230352 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c770002f-ad36-4694-b2f6-a998665236ee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:55.231710 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c770002f-ad36-4694-b2f6-a998665236ee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:55.240663 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c770002f-ad36-4694-b2f6-a998665236ee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:55.241424 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c770002f-ad36-4694-b2f6-a998665236ee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:55.245805 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c770002f-ad36-4694-b2f6-a998665236ee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:55.245805 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c770002f-ad36-4694-b2f6-a998665236ee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:55.573351 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c770002f-ad36-4694-b2f6-a998665236ee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:55.584882 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c770002f-ad36-4694-b2f6-a998665236ee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:55.587215 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c770002f-ad36-4694-b2f6-a998665236ee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:55.588493 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c770002f-ad36-4694-b2f6-a998665236ee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.362672 Feb 28 19:05:55.589128 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 261/533] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:55 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:55.909095 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e32bac0a-1795-400d-9115-c89579194b26 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e2c7550>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:55.977438 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e32bac0a-1795-400d-9115-c89579194b26 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff" status: 200 len: 287 microversion: 2.1 time: 0.071954 Feb 28 19:05:55.978213 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 273/534] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 19:05:55 2022] GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:56.606900 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cc00a095-e3f6-45a5-aea2-b8e474f1f3c9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:56.607540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-cc00a095-e3f6-45a5-aea2-b8e474f1f3c9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:56.614841 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cc00a095-e3f6-45a5-aea2-b8e474f1f3c9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:56.615324 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cc00a095-e3f6-45a5-aea2-b8e474f1f3c9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:56.616095 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cc00a095-e3f6-45a5-aea2-b8e474f1f3c9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:56.616529 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cc00a095-e3f6-45a5-aea2-b8e474f1f3c9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:56.817059 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cc00a095-e3f6-45a5-aea2-b8e474f1f3c9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:56.826563 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cc00a095-e3f6-45a5-aea2-b8e474f1f3c9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:56.828074 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cc00a095-e3f6-45a5-aea2-b8e474f1f3c9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:56.829198 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-cc00a095-e3f6-45a5-aea2-b8e474f1f3c9 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.226401 Feb 28 19:05:56.829748 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 262/535] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:56 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:56.988876 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d1f44279-b31d-4eaf-a340-633422bff36b tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e40fee0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:57.032244 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d1f44279-b31d-4eaf-a340-633422bff36b tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff" status: 200 len: 287 microversion: 2.1 time: 0.047030 Feb 28 19:05:57.032797 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 274/536] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 19:05:56 2022] GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:57.847679 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8e18ba23-d353-4c4a-84cb-dd0bd0fb2ea3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:57.848227 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8e18ba23-d353-4c4a-84cb-dd0bd0fb2ea3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:57.856024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e18ba23-d353-4c4a-84cb-dd0bd0fb2ea3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:57.856472 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e18ba23-d353-4c4a-84cb-dd0bd0fb2ea3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:57.857236 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e18ba23-d353-4c4a-84cb-dd0bd0fb2ea3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:57.857672 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e18ba23-d353-4c4a-84cb-dd0bd0fb2ea3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:58.043898 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-541fdd2c-d95d-4aae-897f-b05d89dd3a6f tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e66a700>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:58.088949 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-541fdd2c-d95d-4aae-897f-b05d89dd3a6f tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff" status: 200 len: 287 microversion: 2.1 time: 0.048936 Feb 28 19:05:58.089515 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 275/537] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 19:05:58 2022] GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:58.196029 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8e18ba23-d353-4c4a-84cb-dd0bd0fb2ea3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:58.204849 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8e18ba23-d353-4c4a-84cb-dd0bd0fb2ea3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:58.206401 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8e18ba23-d353-4c4a-84cb-dd0bd0fb2ea3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:58.207552 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8e18ba23-d353-4c4a-84cb-dd0bd0fb2ea3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.363747 Feb 28 19:05:58.208099 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 263/538] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:57 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:05:59.100832 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cee18ad7-1405-496b-b33d-77c1abb45a6f tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e4110d0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:59.143469 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-cee18ad7-1405-496b-b33d-77c1abb45a6f tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff" status: 200 len: 287 microversion: 2.1 time: 0.046456 Feb 28 19:05:59.144010 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 276/539] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 19:05:59 2022] GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:05:59.227121 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cd06402e-0164-41a0-a6b3-15962e2255a8 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:05:59.227752 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-cd06402e-0164-41a0-a6b3-15962e2255a8 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:05:59.234908 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cd06402e-0164-41a0-a6b3-15962e2255a8 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:59.235472 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cd06402e-0164-41a0-a6b3-15962e2255a8 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:59.236239 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cd06402e-0164-41a0-a6b3-15962e2255a8 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:05:59.236667 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cd06402e-0164-41a0-a6b3-15962e2255a8 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:05:59.508722 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cd06402e-0164-41a0-a6b3-15962e2255a8 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:59.517308 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cd06402e-0164-41a0-a6b3-15962e2255a8 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:59.518803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cd06402e-0164-41a0-a6b3-15962e2255a8 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:05:59.521732 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-cd06402e-0164-41a0-a6b3-15962e2255a8 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1742 microversion: 2.20 time: 0.299050 Feb 28 19:05:59.522281 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 264/540] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:05:59 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1742 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:00.155884 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-35bed6d7-7ed0-4a7a-a3e9-61422292f7b9 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e411820>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:00.200561 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-35bed6d7-7ed0-4a7a-a3e9-61422292f7b9 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff" status: 200 len: 288 microversion: 2.1 time: 0.048638 Feb 28 19:06:00.201213 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 277/541] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 19:06:00 2022] GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff => generated 288 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:06:00.211281 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1ca14427-a3fa-4811-94f7-34e6bc1e7e5d tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e189160>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:00.383704 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1ca14427-a3fa-4811-94f7-34e6bc1e7e5d tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "DELETE /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff" status: 202 len: 0 microversion: 2.1 time: 0.176020 Feb 28 19:06:00.385211 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 265/542] 10.222.0.21 () {58 vars in 1253 bytes} [Mon Feb 28 19:06:00 2022] DELETE /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:06:00.393523 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4c73c737-3e17-4f5b-9c26-0e0383c7ab0e tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e66a700>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:00.438597 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4c73c737-3e17-4f5b-9c26-0e0383c7ab0e tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff" status: 200 len: 287 microversion: 2.1 time: 0.049082 Feb 28 19:06:00.439243 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 278/543] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 19:06:00 2022] GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:06:00.541477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-48aba2f1-d47f-44ac-8beb-2d99d281b24d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:00.542093 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-48aba2f1-d47f-44ac-8beb-2d99d281b24d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:00.549333 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48aba2f1-d47f-44ac-8beb-2d99d281b24d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:00.550373 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48aba2f1-d47f-44ac-8beb-2d99d281b24d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:00.550554 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48aba2f1-d47f-44ac-8beb-2d99d281b24d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:00.550991 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-48aba2f1-d47f-44ac-8beb-2d99d281b24d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:00.760717 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-48aba2f1-d47f-44ac-8beb-2d99d281b24d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:00.771189 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-48aba2f1-d47f-44ac-8beb-2d99d281b24d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:00.773282 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-48aba2f1-d47f-44ac-8beb-2d99d281b24d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:00.789135 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-48aba2f1-d47f-44ac-8beb-2d99d281b24d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1724 microversion: 2.20 time: 0.237388 Feb 28 19:06:00.789135 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 266/544] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:00 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:06:01.450208 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-67ccc82c-a3fb-4991-ae1b-73d24a33d11d tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e40f5e0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:01.489674 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-67ccc82c-a3fb-4991-ae1b-73d24a33d11d tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] HTTP exception thrown: Snapshot 0810e86a-da09-481c-a1eb-bd882fac13ff could not be found. Feb 28 19:06:01.490274 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-67ccc82c-a3fb-4991-ae1b-73d24a33d11d tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Returning 404 to user: Snapshot 0810e86a-da09-481c-a1eb-bd882fac13ff could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:06:01.491086 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-67ccc82c-a3fb-4991-ae1b-73d24a33d11d tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff" status: 404 len: 111 microversion: 2.1 time: 0.044977 Feb 28 19:06:01.491997 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 279/545] 10.222.0.21 () {58 vars in 1250 bytes} [Mon Feb 28 19:06:01 2022] GET /compute/v2.1/os-snapshots/0810e86a-da09-481c-a1eb-bd882fac13ff => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:06:01.502884 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b5c6062d-8d0c-45ec-a2a3-91c6a1212580 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e4e84c0>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:01.747635 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b5c6062d-8d0c-45ec-a2a3-91c6a1212580 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184" status: 202 len: 0 microversion: 2.1 time: 0.248316 Feb 28 19:06:01.748458 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 267/546] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 19:06:01 2022] DELETE /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:06:01.756174 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-15d3be87-866c-4324-bbc1-97c8a6be0ff4 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e40f040>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:01.793503 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-5447d4fa-65f4-4570-88b0-5bb4a84eef06 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:01.794277 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5447d4fa-65f4-4570-88b0-5bb4a84eef06 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:01.802617 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5447d4fa-65f4-4570-88b0-5bb4a84eef06 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:01.803213 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5447d4fa-65f4-4570-88b0-5bb4a84eef06 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:01.804094 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5447d4fa-65f4-4570-88b0-5bb4a84eef06 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:01.805095 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5447d4fa-65f4-4570-88b0-5bb4a84eef06 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:01.837715 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-15d3be87-866c-4324-bbc1-97c8a6be0ff4 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184" status: 200 len: 345 microversion: 2.1 time: 0.085183 Feb 28 19:06:01.838272 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 280/547] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:06:01 2022] GET /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184 => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:06:02.006902 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-5447d4fa-65f4-4570-88b0-5bb4a84eef06 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:02.016029 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-5447d4fa-65f4-4570-88b0-5bb4a84eef06 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:02.017527 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-5447d4fa-65f4-4570-88b0-5bb4a84eef06 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:02.018650 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-5447d4fa-65f4-4570-88b0-5bb4a84eef06 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1724 microversion: 2.20 time: 0.229198 Feb 28 19:06:02.019215 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 268/548] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:01 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:02.849955 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-84d5d925-fca0-4619-930f-2738c7bc84e2 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912f840160>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:02.908647 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-84d5d925-fca0-4619-930f-2738c7bc84e2 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] HTTP exception thrown: Volume 86828326-01c7-41f4-84f3-039631154184 could not be found. Feb 28 19:06:02.909328 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-84d5d925-fca0-4619-930f-2738c7bc84e2 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Returning 404 to user: Volume 86828326-01c7-41f4-84f3-039631154184 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:06:02.910128 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-84d5d925-fca0-4619-930f-2738c7bc84e2 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184" status: 404 len: 109 microversion: 2.1 time: 0.064055 Feb 28 19:06:02.911269 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 281/549] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:06:02 2022] GET /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:06:02.927665 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d43551f7-b812-4781-86b4-85913888220c tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e189e50>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:02.989318 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-d43551f7-b812-4781-86b4-85913888220c tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] HTTP exception thrown: Volume 86828326-01c7-41f4-84f3-039631154184 could not be found. Feb 28 19:06:02.989947 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d43551f7-b812-4781-86b4-85913888220c tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Returning 404 to user: Volume 86828326-01c7-41f4-84f3-039631154184 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:06:02.990760 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d43551f7-b812-4781-86b4-85913888220c tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184" status: 404 len: 109 microversion: 2.1 time: 0.067979 Feb 28 19:06:02.991403 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 269/550] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 19:06:02 2022] DELETE /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:06:02.999085 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-652c6237-92a0-4f81-8fc8-7ceba12a1891 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Calling method '.version_select at 0x7f912e66aaf0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:03.039641 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e5615d6b-9489-4f39-958f-62728b4a091c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:03.040557 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e5615d6b-9489-4f39-958f-62728b4a091c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:03.048376 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e5615d6b-9489-4f39-958f-62728b4a091c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:03.048817 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e5615d6b-9489-4f39-958f-62728b4a091c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:03.049592 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e5615d6b-9489-4f39-958f-62728b4a091c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:03.050025 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e5615d6b-9489-4f39-958f-62728b4a091c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:03.060007 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-652c6237-92a0-4f81-8fc8-7ceba12a1891 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] HTTP exception thrown: Volume 86828326-01c7-41f4-84f3-039631154184 could not be found. Feb 28 19:06:03.060602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-652c6237-92a0-4f81-8fc8-7ceba12a1891 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] Returning 404 to user: Volume 86828326-01c7-41f4-84f3-039631154184 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:06:03.061433 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-652c6237-92a0-4f81-8fc8-7ceba12a1891 tempest-VolumesSnapshotsTestJSON-1718848558 tempest-VolumesSnapshotsTestJSON-1718848558-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184" status: 404 len: 109 microversion: 2.1 time: 0.066036 Feb 28 19:06:03.061961 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 282/551] 10.222.0.21 () {58 vars in 1244 bytes} [Mon Feb 28 19:06:02 2022] GET /compute/v2.1/os-volumes/86828326-01c7-41f4-84f3-039631154184 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:06:03.245786 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e5615d6b-9489-4f39-958f-62728b4a091c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:03.257912 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e5615d6b-9489-4f39-958f-62728b4a091c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:03.257912 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e5615d6b-9489-4f39-958f-62728b4a091c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:03.258487 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e5615d6b-9489-4f39-958f-62728b4a091c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1727 microversion: 2.20 time: 0.223111 Feb 28 19:06:03.269196 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 270/552] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:03 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1727 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:06:03.276754 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-55fab9fa-4cf6-440e-ac0d-966bbf6edb74 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "495ace31-bcb1-4621-95db-4f663b83e570"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:06:03.277862 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-55fab9fa-4cf6-440e-ac0d-966bbf6edb74 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:03.285909 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-55fab9fa-4cf6-440e-ac0d-966bbf6edb74 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:03.286389 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-55fab9fa-4cf6-440e-ac0d-966bbf6edb74 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:03.287367 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-55fab9fa-4cf6-440e-ac0d-966bbf6edb74 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:03.287993 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-55fab9fa-4cf6-440e-ac0d-966bbf6edb74 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:04.472168 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-263e92d1-56d9-42c1-83a4-fbd423c3a706 req-d84433dd-3f79-4434-b7ee-b4641c83d777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70", "name": "network-vif-unplugged", "status": "completed", "tag": "7caa3a37-72ae-4e36-90cf-0f518cb19c37"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:06:04.473918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:06:04.473918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:06:04.482476 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-263e92d1-56d9-42c1-83a4-fbd423c3a706 req-d84433dd-3f79-4434-b7ee-b4641c83d777 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:04.484295 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-263e92d1-56d9-42c1-83a4-fbd423c3a706 req-d84433dd-3f79-4434-b7ee-b4641c83d777 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:04.500439 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.compute.server_external_events [req-263e92d1-56d9-42c1-83a4-fbd423c3a706 req-d84433dd-3f79-4434-b7ee-b4641c83d777 service nova] Unable to find a host for instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70. Dropping event network-vif-unplugged {{(pid=101792) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 28 19:06:04.501364 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-263e92d1-56d9-42c1-83a4-fbd423c3a706 req-d84433dd-3f79-4434-b7ee-b4641c83d777 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033402 Feb 28 19:06:04.502202 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 271/553] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 28 19:06:04.845035 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-55fab9fa-4cf6-440e-ac0d-966bbf6edb74 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "POST /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.572807 Feb 28 19:06:04.845733 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 283/554] 10.222.0.21 () {62 vars in 1363 bytes} [Mon Feb 28 19:06:03 2022] POST /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments => generated 188 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 19:06:05.031582 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-3675b9c5-a52f-41de-b478-b93fde38ce65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:06:05.032125 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3675b9c5-a52f-41de-b478-b93fde38ce65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:05.040025 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3675b9c5-a52f-41de-b478-b93fde38ce65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:05.040739 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3675b9c5-a52f-41de-b478-b93fde38ce65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:05.041515 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3675b9c5-a52f-41de-b478-b93fde38ce65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:05.041945 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3675b9c5-a52f-41de-b478-b93fde38ce65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:05.397204 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-3675b9c5-a52f-41de-b478-b93fde38ce65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "POST /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/action" status: 202 len: 0 microversion: 2.20 time: 0.369145 Feb 28 19:06:05.398053 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 272/555] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Feb 28 19:06:05 2022] POST /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:06:05.406055 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-778cbb77-4e36-4930-8e77-2bb5cc399e65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:05.407196 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-778cbb77-4e36-4930-8e77-2bb5cc399e65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:05.415852 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-778cbb77-4e36-4930-8e77-2bb5cc399e65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:05.416296 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-778cbb77-4e36-4930-8e77-2bb5cc399e65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:05.417257 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-778cbb77-4e36-4930-8e77-2bb5cc399e65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:05.417693 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-778cbb77-4e36-4930-8e77-2bb5cc399e65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:05.622035 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-778cbb77-4e36-4930-8e77-2bb5cc399e65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:05.631300 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-778cbb77-4e36-4930-8e77-2bb5cc399e65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:05.633609 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-778cbb77-4e36-4930-8e77-2bb5cc399e65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:05.634728 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-778cbb77-4e36-4930-8e77-2bb5cc399e65 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1753 microversion: 2.20 time: 0.232528 Feb 28 19:06:05.635307 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 284/556] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:05 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1753 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:06.653854 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-dfafa0d2-1675-4ef9-9ed9-3f2d84d0e9aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:06.655168 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-dfafa0d2-1675-4ef9-9ed9-3f2d84d0e9aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:06.667810 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dfafa0d2-1675-4ef9-9ed9-3f2d84d0e9aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:06.668986 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dfafa0d2-1675-4ef9-9ed9-3f2d84d0e9aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:06.670013 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dfafa0d2-1675-4ef9-9ed9-3f2d84d0e9aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:06.670638 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dfafa0d2-1675-4ef9-9ed9-3f2d84d0e9aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:06.908560 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dfafa0d2-1675-4ef9-9ed9-3f2d84d0e9aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:06.919057 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dfafa0d2-1675-4ef9-9ed9-3f2d84d0e9aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:06.920593 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dfafa0d2-1675-4ef9-9ed9-3f2d84d0e9aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:06.921753 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-dfafa0d2-1675-4ef9-9ed9-3f2d84d0e9aa tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1753 microversion: 2.20 time: 0.272829 Feb 28 19:06:06.922320 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 273/557] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:06 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1753 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:07.940396 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c1918265-c8d6-4b3c-ab43-29a3dea613dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:07.941568 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c1918265-c8d6-4b3c-ab43-29a3dea613dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:07.949663 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c1918265-c8d6-4b3c-ab43-29a3dea613dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:07.952089 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c1918265-c8d6-4b3c-ab43-29a3dea613dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:07.952089 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c1918265-c8d6-4b3c-ab43-29a3dea613dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:07.952089 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c1918265-c8d6-4b3c-ab43-29a3dea613dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:08.159536 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c1918265-c8d6-4b3c-ab43-29a3dea613dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:08.170318 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c1918265-c8d6-4b3c-ab43-29a3dea613dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:08.176506 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c1918265-c8d6-4b3c-ab43-29a3dea613dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:08.176506 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c1918265-c8d6-4b3c-ab43-29a3dea613dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1755 microversion: 2.20 time: 0.236586 Feb 28 19:06:08.176506 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 285/558] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:07 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1755 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:09.191813 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0ef2efbb-6a32-4306-a80d-577893194284 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:09.192433 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0ef2efbb-6a32-4306-a80d-577893194284 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:09.202423 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0ef2efbb-6a32-4306-a80d-577893194284 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:09.203173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0ef2efbb-6a32-4306-a80d-577893194284 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:09.203965 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0ef2efbb-6a32-4306-a80d-577893194284 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:09.204501 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0ef2efbb-6a32-4306-a80d-577893194284 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:09.420848 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0ef2efbb-6a32-4306-a80d-577893194284 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:09.431237 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0ef2efbb-6a32-4306-a80d-577893194284 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:09.433170 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0ef2efbb-6a32-4306-a80d-577893194284 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:09.434509 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0ef2efbb-6a32-4306-a80d-577893194284 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1755 microversion: 2.20 time: 0.246653 Feb 28 19:06:09.445768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 274/559] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:09 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1755 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:10.454504 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c21dbd88-cfe0-4a46-a586-4723c63a7e9f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:10.457142 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c21dbd88-cfe0-4a46-a586-4723c63a7e9f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:10.466120 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c21dbd88-cfe0-4a46-a586-4723c63a7e9f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:10.466725 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c21dbd88-cfe0-4a46-a586-4723c63a7e9f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:10.467959 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c21dbd88-cfe0-4a46-a586-4723c63a7e9f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:10.468621 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c21dbd88-cfe0-4a46-a586-4723c63a7e9f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:10.681975 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c21dbd88-cfe0-4a46-a586-4723c63a7e9f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:10.691271 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c21dbd88-cfe0-4a46-a586-4723c63a7e9f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:10.692819 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c21dbd88-cfe0-4a46-a586-4723c63a7e9f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:10.693924 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c21dbd88-cfe0-4a46-a586-4723c63a7e9f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.243835 Feb 28 19:06:10.694895 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 286/560] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:10 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:06:11.714462 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-58904f79-3a55-4159-82f2-7e51e321f098 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:11.715381 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-58904f79-3a55-4159-82f2-7e51e321f098 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:11.723820 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-58904f79-3a55-4159-82f2-7e51e321f098 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:11.724270 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-58904f79-3a55-4159-82f2-7e51e321f098 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:11.725431 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-58904f79-3a55-4159-82f2-7e51e321f098 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:11.725779 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-58904f79-3a55-4159-82f2-7e51e321f098 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:12.109799 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-58904f79-3a55-4159-82f2-7e51e321f098 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:12.120132 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-58904f79-3a55-4159-82f2-7e51e321f098 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:12.121719 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-58904f79-3a55-4159-82f2-7e51e321f098 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:12.123041 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-58904f79-3a55-4159-82f2-7e51e321f098 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.414166 Feb 28 19:06:12.124011 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 275/561] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:11 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:13.141580 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8f271ab2-a174-4c2b-b807-d1b86a09f1ae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:13.142222 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8f271ab2-a174-4c2b-b807-d1b86a09f1ae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:13.150542 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8f271ab2-a174-4c2b-b807-d1b86a09f1ae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:13.150990 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8f271ab2-a174-4c2b-b807-d1b86a09f1ae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:13.151874 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8f271ab2-a174-4c2b-b807-d1b86a09f1ae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:13.152357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8f271ab2-a174-4c2b-b807-d1b86a09f1ae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:13.374259 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8f271ab2-a174-4c2b-b807-d1b86a09f1ae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:13.387161 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8f271ab2-a174-4c2b-b807-d1b86a09f1ae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:13.388861 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8f271ab2-a174-4c2b-b807-d1b86a09f1ae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:13.390061 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8f271ab2-a174-4c2b-b807-d1b86a09f1ae tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.252157 Feb 28 19:06:13.390603 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 287/562] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:13 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:14.408415 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-dfdc0c3f-e566-4631-98e3-a903f0ebb7af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:14.409754 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-dfdc0c3f-e566-4631-98e3-a903f0ebb7af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:14.425532 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dfdc0c3f-e566-4631-98e3-a903f0ebb7af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:14.426109 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dfdc0c3f-e566-4631-98e3-a903f0ebb7af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:14.426939 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dfdc0c3f-e566-4631-98e3-a903f0ebb7af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:14.427417 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dfdc0c3f-e566-4631-98e3-a903f0ebb7af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:14.662811 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dfdc0c3f-e566-4631-98e3-a903f0ebb7af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:14.672581 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dfdc0c3f-e566-4631-98e3-a903f0ebb7af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:14.674311 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dfdc0c3f-e566-4631-98e3-a903f0ebb7af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:14.675454 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-dfdc0c3f-e566-4631-98e3-a903f0ebb7af tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.271090 Feb 28 19:06:14.675996 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 276/563] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:14 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:06:15.693985 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-94d74184-300b-4a20-bc14-4d8eff234cd5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:15.694817 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-94d74184-300b-4a20-bc14-4d8eff234cd5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:15.702790 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-94d74184-300b-4a20-bc14-4d8eff234cd5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:15.703722 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-94d74184-300b-4a20-bc14-4d8eff234cd5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:15.704698 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-94d74184-300b-4a20-bc14-4d8eff234cd5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:15.705211 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-94d74184-300b-4a20-bc14-4d8eff234cd5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:16.033311 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-94d74184-300b-4a20-bc14-4d8eff234cd5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:16.043732 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-94d74184-300b-4a20-bc14-4d8eff234cd5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:16.045230 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-94d74184-300b-4a20-bc14-4d8eff234cd5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:16.046353 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-94d74184-300b-4a20-bc14-4d8eff234cd5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.356093 Feb 28 19:06:16.046933 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 288/564] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:15 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:17.066024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-58ee7db2-04d4-4b30-9771-c7198e9ef130 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:17.072039 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-58ee7db2-04d4-4b30-9771-c7198e9ef130 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:17.089318 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-58ee7db2-04d4-4b30-9771-c7198e9ef130 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:17.089994 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-58ee7db2-04d4-4b30-9771-c7198e9ef130 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:17.091130 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-58ee7db2-04d4-4b30-9771-c7198e9ef130 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:17.091736 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-58ee7db2-04d4-4b30-9771-c7198e9ef130 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:17.388817 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-58ee7db2-04d4-4b30-9771-c7198e9ef130 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:17.421757 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-58ee7db2-04d4-4b30-9771-c7198e9ef130 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:17.435871 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-58ee7db2-04d4-4b30-9771-c7198e9ef130 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:17.435871 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-58ee7db2-04d4-4b30-9771-c7198e9ef130 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.367272 Feb 28 19:06:17.435871 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 277/565] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:17 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:18.449553 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-bbb401c9-b415-4948-b1e7-16b30c888c47 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:18.450167 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-bbb401c9-b415-4948-b1e7-16b30c888c47 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:18.459431 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bbb401c9-b415-4948-b1e7-16b30c888c47 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:18.467426 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bbb401c9-b415-4948-b1e7-16b30c888c47 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:18.467426 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bbb401c9-b415-4948-b1e7-16b30c888c47 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:18.467426 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bbb401c9-b415-4948-b1e7-16b30c888c47 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:18.801474 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bbb401c9-b415-4948-b1e7-16b30c888c47 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:18.811249 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bbb401c9-b415-4948-b1e7-16b30c888c47 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:18.812765 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bbb401c9-b415-4948-b1e7-16b30c888c47 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:18.813886 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-bbb401c9-b415-4948-b1e7-16b30c888c47 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.369125 Feb 28 19:06:18.814432 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 289/566] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:18 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:19.834263 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d83632b0-b0e6-4079-9319-19c8aec4a585 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:19.835893 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d83632b0-b0e6-4079-9319-19c8aec4a585 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:19.843313 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d83632b0-b0e6-4079-9319-19c8aec4a585 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:19.843770 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d83632b0-b0e6-4079-9319-19c8aec4a585 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:19.844579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d83632b0-b0e6-4079-9319-19c8aec4a585 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:19.845013 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d83632b0-b0e6-4079-9319-19c8aec4a585 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:20.072363 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d83632b0-b0e6-4079-9319-19c8aec4a585 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:20.093307 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d83632b0-b0e6-4079-9319-19c8aec4a585 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:20.095624 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d83632b0-b0e6-4079-9319-19c8aec4a585 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:20.097596 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d83632b0-b0e6-4079-9319-19c8aec4a585 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.267697 Feb 28 19:06:20.104918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 278/567] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:19 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:21.117983 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-51bcbf8d-3e6d-458c-ba43-4af4a7f321d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:21.118743 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-51bcbf8d-3e6d-458c-ba43-4af4a7f321d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:21.125911 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-51bcbf8d-3e6d-458c-ba43-4af4a7f321d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:21.126350 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-51bcbf8d-3e6d-458c-ba43-4af4a7f321d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:21.127135 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-51bcbf8d-3e6d-458c-ba43-4af4a7f321d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:21.127769 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-51bcbf8d-3e6d-458c-ba43-4af4a7f321d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:21.339739 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-51bcbf8d-3e6d-458c-ba43-4af4a7f321d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:21.342102 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-51bcbf8d-3e6d-458c-ba43-4af4a7f321d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:21.343624 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-51bcbf8d-3e6d-458c-ba43-4af4a7f321d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:21.344777 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-51bcbf8d-3e6d-458c-ba43-4af4a7f321d0 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.231105 Feb 28 19:06:21.345336 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 290/568] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:21 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:22.362584 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-02a59b35-983d-402a-be65-441bf26f8401 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:22.363296 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-02a59b35-983d-402a-be65-441bf26f8401 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:22.370735 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-02a59b35-983d-402a-be65-441bf26f8401 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:22.371230 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-02a59b35-983d-402a-be65-441bf26f8401 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:22.372089 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-02a59b35-983d-402a-be65-441bf26f8401 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:22.378488 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-02a59b35-983d-402a-be65-441bf26f8401 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:22.591426 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-02a59b35-983d-402a-be65-441bf26f8401 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:22.601784 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-02a59b35-983d-402a-be65-441bf26f8401 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:22.603446 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-02a59b35-983d-402a-be65-441bf26f8401 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:22.604537 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-02a59b35-983d-402a-be65-441bf26f8401 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.245674 Feb 28 19:06:22.605079 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 279/569] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:22 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:23.622703 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e681cf11-c216-4741-9a8b-74b5016808b5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:23.623351 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e681cf11-c216-4741-9a8b-74b5016808b5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:23.630811 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e681cf11-c216-4741-9a8b-74b5016808b5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:23.631321 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e681cf11-c216-4741-9a8b-74b5016808b5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:23.632310 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e681cf11-c216-4741-9a8b-74b5016808b5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:23.632770 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e681cf11-c216-4741-9a8b-74b5016808b5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:23.826770 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e681cf11-c216-4741-9a8b-74b5016808b5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:23.836327 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e681cf11-c216-4741-9a8b-74b5016808b5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:23.837806 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e681cf11-c216-4741-9a8b-74b5016808b5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:23.838914 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e681cf11-c216-4741-9a8b-74b5016808b5 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.219931 Feb 28 19:06:23.839492 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 291/570] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:23 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:24.856852 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a7144b8e-f600-44ac-8f73-3dea0f3bb201 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:24.857460 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a7144b8e-f600-44ac-8f73-3dea0f3bb201 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:24.864823 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7144b8e-f600-44ac-8f73-3dea0f3bb201 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:24.865275 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7144b8e-f600-44ac-8f73-3dea0f3bb201 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:24.870371 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7144b8e-f600-44ac-8f73-3dea0f3bb201 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:24.870371 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7144b8e-f600-44ac-8f73-3dea0f3bb201 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:25.064014 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a7144b8e-f600-44ac-8f73-3dea0f3bb201 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:25.076507 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a7144b8e-f600-44ac-8f73-3dea0f3bb201 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:25.078036 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a7144b8e-f600-44ac-8f73-3dea0f3bb201 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:25.079179 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a7144b8e-f600-44ac-8f73-3dea0f3bb201 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.226042 Feb 28 19:06:25.079727 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 280/571] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:24 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:26.097418 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5a46d854-50ad-4ac6-9f44-182e820472e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:26.098074 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5a46d854-50ad-4ac6-9f44-182e820472e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:26.106190 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5a46d854-50ad-4ac6-9f44-182e820472e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:26.106717 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5a46d854-50ad-4ac6-9f44-182e820472e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:26.107779 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5a46d854-50ad-4ac6-9f44-182e820472e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:26.108221 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5a46d854-50ad-4ac6-9f44-182e820472e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:26.307619 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5a46d854-50ad-4ac6-9f44-182e820472e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:26.316693 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5a46d854-50ad-4ac6-9f44-182e820472e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:26.318166 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5a46d854-50ad-4ac6-9f44-182e820472e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:26.320117 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5a46d854-50ad-4ac6-9f44-182e820472e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.226552 Feb 28 19:06:26.320676 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 292/572] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:26 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:27.338863 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-195ac13f-45ca-4579-a674-be4c0a8aeb4c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:27.339413 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-195ac13f-45ca-4579-a674-be4c0a8aeb4c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:27.346560 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-195ac13f-45ca-4579-a674-be4c0a8aeb4c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:27.346998 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-195ac13f-45ca-4579-a674-be4c0a8aeb4c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:27.347787 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-195ac13f-45ca-4579-a674-be4c0a8aeb4c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:27.348216 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-195ac13f-45ca-4579-a674-be4c0a8aeb4c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:27.537817 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-195ac13f-45ca-4579-a674-be4c0a8aeb4c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:27.546978 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-195ac13f-45ca-4579-a674-be4c0a8aeb4c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:27.548491 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-195ac13f-45ca-4579-a674-be4c0a8aeb4c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:27.549596 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-195ac13f-45ca-4579-a674-be4c0a8aeb4c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.215191 Feb 28 19:06:27.550142 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 281/573] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:27 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:28.567939 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-394c4d0b-64f9-40db-a5d0-de64d0ea0f68 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:28.568549 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-394c4d0b-64f9-40db-a5d0-de64d0ea0f68 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:28.576301 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-394c4d0b-64f9-40db-a5d0-de64d0ea0f68 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:28.576747 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-394c4d0b-64f9-40db-a5d0-de64d0ea0f68 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:28.577514 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-394c4d0b-64f9-40db-a5d0-de64d0ea0f68 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:28.577942 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-394c4d0b-64f9-40db-a5d0-de64d0ea0f68 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:28.775033 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-394c4d0b-64f9-40db-a5d0-de64d0ea0f68 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:28.784059 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-394c4d0b-64f9-40db-a5d0-de64d0ea0f68 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:28.785559 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-394c4d0b-64f9-40db-a5d0-de64d0ea0f68 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:28.788389 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-394c4d0b-64f9-40db-a5d0-de64d0ea0f68 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.222406 Feb 28 19:06:28.788389 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 293/574] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:28 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:29.806724 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ca2e2f59-e819-409a-85b3-34be224dfe04 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:29.807434 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ca2e2f59-e819-409a-85b3-34be224dfe04 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:29.814976 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ca2e2f59-e819-409a-85b3-34be224dfe04 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:29.815448 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ca2e2f59-e819-409a-85b3-34be224dfe04 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:29.816294 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ca2e2f59-e819-409a-85b3-34be224dfe04 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:29.816742 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ca2e2f59-e819-409a-85b3-34be224dfe04 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:30.029007 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ca2e2f59-e819-409a-85b3-34be224dfe04 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:30.038060 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ca2e2f59-e819-409a-85b3-34be224dfe04 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:30.041713 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ca2e2f59-e819-409a-85b3-34be224dfe04 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:30.041713 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ca2e2f59-e819-409a-85b3-34be224dfe04 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.239584 Feb 28 19:06:30.042108 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 282/575] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:29 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:31.060173 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-48fe4394-68a0-48fa-b165-59988e67bdda tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:31.060915 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-48fe4394-68a0-48fa-b165-59988e67bdda tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:31.068637 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-48fe4394-68a0-48fa-b165-59988e67bdda tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:31.069323 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-48fe4394-68a0-48fa-b165-59988e67bdda tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:31.070116 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-48fe4394-68a0-48fa-b165-59988e67bdda tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:31.070565 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-48fe4394-68a0-48fa-b165-59988e67bdda tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:31.281121 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-48fe4394-68a0-48fa-b165-59988e67bdda tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:31.290719 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-48fe4394-68a0-48fa-b165-59988e67bdda tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:31.292231 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-48fe4394-68a0-48fa-b165-59988e67bdda tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:31.293354 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-48fe4394-68a0-48fa-b165-59988e67bdda tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.237443 Feb 28 19:06:31.293900 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 294/576] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:31 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:32.311524 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-69472929-b0a9-4e36-95d6-c0671823dae2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:32.312115 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-69472929-b0a9-4e36-95d6-c0671823dae2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:32.319132 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-69472929-b0a9-4e36-95d6-c0671823dae2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:32.319588 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-69472929-b0a9-4e36-95d6-c0671823dae2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:32.320345 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-69472929-b0a9-4e36-95d6-c0671823dae2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:32.320773 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-69472929-b0a9-4e36-95d6-c0671823dae2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:32.536530 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-69472929-b0a9-4e36-95d6-c0671823dae2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:32.547953 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-69472929-b0a9-4e36-95d6-c0671823dae2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:32.549444 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-69472929-b0a9-4e36-95d6-c0671823dae2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:32.550570 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-69472929-b0a9-4e36-95d6-c0671823dae2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.242705 Feb 28 19:06:32.551139 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 283/577] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:32 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:33.568923 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-112be813-d068-490a-9bf4-cc45c1cb70d2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:33.569567 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-112be813-d068-490a-9bf4-cc45c1cb70d2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:33.577015 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-112be813-d068-490a-9bf4-cc45c1cb70d2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:33.577471 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-112be813-d068-490a-9bf4-cc45c1cb70d2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:33.578253 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-112be813-d068-490a-9bf4-cc45c1cb70d2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:33.578687 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-112be813-d068-490a-9bf4-cc45c1cb70d2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:33.779365 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-112be813-d068-490a-9bf4-cc45c1cb70d2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:33.788359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-112be813-d068-490a-9bf4-cc45c1cb70d2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:33.789954 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-112be813-d068-490a-9bf4-cc45c1cb70d2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:33.791062 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-112be813-d068-490a-9bf4-cc45c1cb70d2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.225917 Feb 28 19:06:33.792443 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 295/578] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:33 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:34.688845 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-33d29525-e2d2-492f-9141-e18003849009 req-473a60d3-e9b1-4bde-914a-7badf59aa668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70", "name": "network-vif-plugged", "status": "completed", "tag": "7caa3a37-72ae-4e36-90cf-0f518cb19c37"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:06:34.690263 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:06:34.690263 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:06:34.698854 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-33d29525-e2d2-492f-9141-e18003849009 req-473a60d3-e9b1-4bde-914a-7badf59aa668 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:34.699332 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-33d29525-e2d2-492f-9141-e18003849009 req-473a60d3-e9b1-4bde-914a-7badf59aa668 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:34.715166 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-33d29525-e2d2-492f-9141-e18003849009 req-473a60d3-e9b1-4bde-914a-7badf59aa668 service nova] Creating event network-vif-plugged:7caa3a37-72ae-4e36-90cf-0f518cb19c37 for instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 on hv-cinder-83118 Feb 28 19:06:34.720055 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-33d29525-e2d2-492f-9141-e18003849009 req-473a60d3-e9b1-4bde-914a-7badf59aa668 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034797 Feb 28 19:06:34.720701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 284/579] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:06:34.810506 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-295c0f20-8503-4f68-aff3-cd90313a5bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:34.811223 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-295c0f20-8503-4f68-aff3-cd90313a5bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:34.818758 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-295c0f20-8503-4f68-aff3-cd90313a5bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:34.819317 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-295c0f20-8503-4f68-aff3-cd90313a5bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:34.820383 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-295c0f20-8503-4f68-aff3-cd90313a5bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:34.820671 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-295c0f20-8503-4f68-aff3-cd90313a5bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:35.026462 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-295c0f20-8503-4f68-aff3-cd90313a5bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:35.035821 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-295c0f20-8503-4f68-aff3-cd90313a5bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:35.037588 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-295c0f20-8503-4f68-aff3-cd90313a5bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:35.038718 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-295c0f20-8503-4f68-aff3-cd90313a5bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.232610 Feb 28 19:06:35.039534 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 296/580] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:34 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:36.058125 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b039eead-b836-493c-ac37-a26ea867bace tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:36.058764 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b039eead-b836-493c-ac37-a26ea867bace tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:36.066961 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b039eead-b836-493c-ac37-a26ea867bace tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:36.067635 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b039eead-b836-493c-ac37-a26ea867bace tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:36.068423 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b039eead-b836-493c-ac37-a26ea867bace tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:36.069425 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b039eead-b836-493c-ac37-a26ea867bace tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:36.326145 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b039eead-b836-493c-ac37-a26ea867bace tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:36.336133 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b039eead-b836-493c-ac37-a26ea867bace tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:36.337701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b039eead-b836-493c-ac37-a26ea867bace tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:36.339667 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b039eead-b836-493c-ac37-a26ea867bace tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.284984 Feb 28 19:06:36.344374 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 285/581] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:36 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:37.357908 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-82029157-c1eb-421a-99f9-3b353347ac0e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:37.358509 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-82029157-c1eb-421a-99f9-3b353347ac0e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:37.366253 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-82029157-c1eb-421a-99f9-3b353347ac0e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:37.367047 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-82029157-c1eb-421a-99f9-3b353347ac0e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:37.367956 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-82029157-c1eb-421a-99f9-3b353347ac0e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:37.368448 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-82029157-c1eb-421a-99f9-3b353347ac0e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:37.769980 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-82029157-c1eb-421a-99f9-3b353347ac0e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:37.781542 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-82029157-c1eb-421a-99f9-3b353347ac0e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:37.783135 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-82029157-c1eb-421a-99f9-3b353347ac0e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:37.793204 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-82029157-c1eb-421a-99f9-3b353347ac0e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1811 microversion: 2.20 time: 0.430530 Feb 28 19:06:37.793204 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 297/582] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:37 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1811 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:06:38.803884 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ffbd26a5-d79b-411a-84c7-69fc20be8f56 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:06:38.804485 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ffbd26a5-d79b-411a-84c7-69fc20be8f56 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:06:38.811491 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ffbd26a5-d79b-411a-84c7-69fc20be8f56 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:38.811935 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ffbd26a5-d79b-411a-84c7-69fc20be8f56 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:38.812746 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ffbd26a5-d79b-411a-84c7-69fc20be8f56 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:06:38.813349 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ffbd26a5-d79b-411a-84c7-69fc20be8f56 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:06:39.269780 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ffbd26a5-d79b-411a-84c7-69fc20be8f56 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:39.280619 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ffbd26a5-d79b-411a-84c7-69fc20be8f56 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:39.282107 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ffbd26a5-d79b-411a-84c7-69fc20be8f56 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:06:39.283257 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ffbd26a5-d79b-411a-84c7-69fc20be8f56 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1798 microversion: 2.20 time: 0.483042 Feb 28 19:06:39.283801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 286/583] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:06:38 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1798 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:07:01.235983 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-da5fa8cb-6e6e-4bff-b3cf-3648a62d9fe2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:01.236604 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-da5fa8cb-6e6e-4bff-b3cf-3648a62d9fe2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:01.244570 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da5fa8cb-6e6e-4bff-b3cf-3648a62d9fe2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:01.245101 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da5fa8cb-6e6e-4bff-b3cf-3648a62d9fe2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:01.245956 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da5fa8cb-6e6e-4bff-b3cf-3648a62d9fe2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:01.246459 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da5fa8cb-6e6e-4bff-b3cf-3648a62d9fe2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:01.419727 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-da5fa8cb-6e6e-4bff-b3cf-3648a62d9fe2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lazy-loading 'services' on Instance uuid 45883a52-0422-4de3-b428-d6f24780b283 {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:07:01.718733 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-da5fa8cb-6e6e-4bff-b3cf-3648a62d9fe2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "DELETE /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/os-volume_attachments/97d1363f-4d05-47c3-8e16-8b5adabc92a9" status: 202 len: 0 microversion: 2.1 time: 0.486080 Feb 28 19:07:01.720120 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 298/584] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:07:01 2022] DELETE /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/os-volume_attachments/97d1363f-4d05-47c3-8e16-8b5adabc92a9 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:07:03.181938 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a7a652ad-64a4-4ec7-a00c-79dfe6401f8f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:07:03.189778 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7a652ad-64a4-4ec7-a00c-79dfe6401f8f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:03.190450 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7a652ad-64a4-4ec7-a00c-79dfe6401f8f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:03.249369 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a7a652ad-64a4-4ec7-a00c-79dfe6401f8f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Going to try to stop instance {{(pid=101792) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Feb 28 19:07:03.458156 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a7a652ad-64a4-4ec7-a00c-79dfe6401f8f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "POST /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/action" status: 202 len: 0 microversion: 2.1 time: 0.279813 Feb 28 19:07:03.459162 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 287/585] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:07:03 2022] POST /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:07:03.474090 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-eff8d5ce-bd08-43d2-a687-e6e528c447cd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:03.476967 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-eff8d5ce-bd08-43d2-a687-e6e528c447cd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:03.486248 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eff8d5ce-bd08-43d2-a687-e6e528c447cd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:03.486693 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eff8d5ce-bd08-43d2-a687-e6e528c447cd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:03.487823 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eff8d5ce-bd08-43d2-a687-e6e528c447cd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:03.488766 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eff8d5ce-bd08-43d2-a687-e6e528c447cd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:03.723095 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-eff8d5ce-bd08-43d2-a687-e6e528c447cd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:03.732122 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-eff8d5ce-bd08-43d2-a687-e6e528c447cd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.267608 Feb 28 19:07:03.732700 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 299/586] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:03 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:04.750054 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e2b4f58e-4836-4192-89f4-011750559fed tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:04.751829 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e2b4f58e-4836-4192-89f4-011750559fed tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:04.769852 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2b4f58e-4836-4192-89f4-011750559fed tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:04.770285 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2b4f58e-4836-4192-89f4-011750559fed tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:04.774656 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2b4f58e-4836-4192-89f4-011750559fed tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:04.776591 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2b4f58e-4836-4192-89f4-011750559fed tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:05.208202 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e2b4f58e-4836-4192-89f4-011750559fed tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:05.217642 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e2b4f58e-4836-4192-89f4-011750559fed tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.471642 Feb 28 19:07:05.218513 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 288/587] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:04 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:07:05.523033 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5e51020d-835b-4800-ae15-d9abf1994e8d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Action: 'create', calling method: .version_select at 0x7f912e675430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1298881284"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:07:05.545375 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-5e51020d-835b-4800-ae15-d9abf1994e8d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Getting quotas for project 90acc320256d4622a351a587d9f604c3. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:07:05.549185 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-5e51020d-835b-4800-ae15-d9abf1994e8d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Getting quotas for user 59f038939b324d9b8e7214cec4e82933 and project 90acc320256d4622a351a587d9f604c3. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:07:05.752460 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-5e51020d-835b-4800-ae15-d9abf1994e8d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Getting quotas for project 90acc320256d4622a351a587d9f604c3. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:07:05.756145 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-5e51020d-835b-4800-ae15-d9abf1994e8d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Getting quotas for user 59f038939b324d9b8e7214cec4e82933 and project 90acc320256d4622a351a587d9f604c3. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:07:05.769726 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5e51020d-835b-4800-ae15-d9abf1994e8d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.425050 Feb 28 19:07:05.770319 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 300/588] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Feb 28 19:07:05 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:06.234942 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-887a3cf6-61da-4383-ae63-cbd06d08b9d9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:06.235575 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-887a3cf6-61da-4383-ae63-cbd06d08b9d9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:06.242739 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-887a3cf6-61da-4383-ae63-cbd06d08b9d9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:06.243209 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-887a3cf6-61da-4383-ae63-cbd06d08b9d9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:06.244625 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-887a3cf6-61da-4383-ae63-cbd06d08b9d9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:06.245198 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-887a3cf6-61da-4383-ae63-cbd06d08b9d9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:06.504262 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-887a3cf6-61da-4383-ae63-cbd06d08b9d9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:06.512626 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-887a3cf6-61da-4383-ae63-cbd06d08b9d9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.281390 Feb 28 19:07:06.513173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 289/589] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:06 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:07.529364 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7d195e28-5f35-4dc6-9f2f-5465e11782b6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:07.529978 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7d195e28-5f35-4dc6-9f2f-5465e11782b6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:07.537799 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7d195e28-5f35-4dc6-9f2f-5465e11782b6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:07.538496 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7d195e28-5f35-4dc6-9f2f-5465e11782b6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:07.539295 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7d195e28-5f35-4dc6-9f2f-5465e11782b6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:07.539732 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7d195e28-5f35-4dc6-9f2f-5465e11782b6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:07.752250 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7d195e28-5f35-4dc6-9f2f-5465e11782b6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:07.761645 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7d195e28-5f35-4dc6-9f2f-5465e11782b6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.236419 Feb 28 19:07:07.762758 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 301/590] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:07 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:08.778953 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ee8631ef-4b3f-4522-b089-c7e48a55be4b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:08.780196 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ee8631ef-4b3f-4522-b089-c7e48a55be4b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:08.787513 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ee8631ef-4b3f-4522-b089-c7e48a55be4b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:08.787955 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ee8631ef-4b3f-4522-b089-c7e48a55be4b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:08.788978 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ee8631ef-4b3f-4522-b089-c7e48a55be4b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:08.789512 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ee8631ef-4b3f-4522-b089-c7e48a55be4b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:08.997612 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ee8631ef-4b3f-4522-b089-c7e48a55be4b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:09.006921 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ee8631ef-4b3f-4522-b089-c7e48a55be4b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.231449 Feb 28 19:07:09.018251 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 290/591] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:08 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:10.024818 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d1585250-be02-456d-9b00-e7a860170ec9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:10.025572 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d1585250-be02-456d-9b00-e7a860170ec9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:10.033081 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d1585250-be02-456d-9b00-e7a860170ec9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:10.033649 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d1585250-be02-456d-9b00-e7a860170ec9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:10.034565 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d1585250-be02-456d-9b00-e7a860170ec9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:10.035092 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d1585250-be02-456d-9b00-e7a860170ec9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:10.249837 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d1585250-be02-456d-9b00-e7a860170ec9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:10.258150 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d1585250-be02-456d-9b00-e7a860170ec9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.237857 Feb 28 19:07:10.258719 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 302/592] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:10 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:11.274900 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ef473414-bed2-45bc-b752-6d4208bb3ccd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:11.275934 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ef473414-bed2-45bc-b752-6d4208bb3ccd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:11.283477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ef473414-bed2-45bc-b752-6d4208bb3ccd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:11.283921 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ef473414-bed2-45bc-b752-6d4208bb3ccd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:11.284674 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ef473414-bed2-45bc-b752-6d4208bb3ccd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:11.285100 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ef473414-bed2-45bc-b752-6d4208bb3ccd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:11.485631 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ef473414-bed2-45bc-b752-6d4208bb3ccd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:11.493911 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ef473414-bed2-45bc-b752-6d4208bb3ccd tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.222693 Feb 28 19:07:11.495132 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 291/593] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:11 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:12.512241 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5bb4ca65-569c-4fec-856e-11dc4511f669 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:12.513582 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5bb4ca65-569c-4fec-856e-11dc4511f669 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:12.520901 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5bb4ca65-569c-4fec-856e-11dc4511f669 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:12.521337 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5bb4ca65-569c-4fec-856e-11dc4511f669 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:12.522109 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5bb4ca65-569c-4fec-856e-11dc4511f669 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:12.522537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5bb4ca65-569c-4fec-856e-11dc4511f669 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:12.809505 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5bb4ca65-569c-4fec-856e-11dc4511f669 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:12.820111 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5bb4ca65-569c-4fec-856e-11dc4511f669 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.312219 Feb 28 19:07:12.821035 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 303/594] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:12 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:13.837865 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ed4c8250-4b6d-43d8-a4b8-01bac158c00a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:13.838601 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ed4c8250-4b6d-43d8-a4b8-01bac158c00a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:13.845997 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ed4c8250-4b6d-43d8-a4b8-01bac158c00a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:13.846494 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ed4c8250-4b6d-43d8-a4b8-01bac158c00a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:13.847400 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ed4c8250-4b6d-43d8-a4b8-01bac158c00a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:13.847812 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ed4c8250-4b6d-43d8-a4b8-01bac158c00a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:14.047606 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ed4c8250-4b6d-43d8-a4b8-01bac158c00a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:14.056167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ed4c8250-4b6d-43d8-a4b8-01bac158c00a tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.221924 Feb 28 19:07:14.057157 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 292/595] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:13 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:15.073146 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-749b3b0e-6b7a-44c8-ad36-482e50d0be72 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:15.073744 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-749b3b0e-6b7a-44c8-ad36-482e50d0be72 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:15.081973 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-749b3b0e-6b7a-44c8-ad36-482e50d0be72 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:15.082525 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-749b3b0e-6b7a-44c8-ad36-482e50d0be72 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:15.083497 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-749b3b0e-6b7a-44c8-ad36-482e50d0be72 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:15.084168 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-749b3b0e-6b7a-44c8-ad36-482e50d0be72 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:15.288818 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-749b3b0e-6b7a-44c8-ad36-482e50d0be72 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:15.297181 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-749b3b0e-6b7a-44c8-ad36-482e50d0be72 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.228264 Feb 28 19:07:15.297730 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 304/596] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:15 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:16.314150 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8d6ce46a-1f4c-487e-a019-35f8d03f7f0f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:16.314809 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8d6ce46a-1f4c-487e-a019-35f8d03f7f0f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:16.322169 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d6ce46a-1f4c-487e-a019-35f8d03f7f0f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:16.322619 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d6ce46a-1f4c-487e-a019-35f8d03f7f0f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:16.323424 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d6ce46a-1f4c-487e-a019-35f8d03f7f0f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:16.323849 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d6ce46a-1f4c-487e-a019-35f8d03f7f0f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:16.527046 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8d6ce46a-1f4c-487e-a019-35f8d03f7f0f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:16.535092 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8d6ce46a-1f4c-487e-a019-35f8d03f7f0f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.224647 Feb 28 19:07:16.535666 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 293/597] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:16 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:17.552947 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-67b903b7-a18f-4db7-ad8d-66343740a937 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:17.553545 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-67b903b7-a18f-4db7-ad8d-66343740a937 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:17.561245 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-67b903b7-a18f-4db7-ad8d-66343740a937 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:17.561692 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-67b903b7-a18f-4db7-ad8d-66343740a937 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:17.562466 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-67b903b7-a18f-4db7-ad8d-66343740a937 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:17.562910 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-67b903b7-a18f-4db7-ad8d-66343740a937 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:17.762689 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-67b903b7-a18f-4db7-ad8d-66343740a937 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:17.772484 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-67b903b7-a18f-4db7-ad8d-66343740a937 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.223147 Feb 28 19:07:17.773052 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 305/598] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:17 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:18.789694 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-de110fd6-b8e3-4a92-bae3-49b2d3c51130 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:18.790301 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-de110fd6-b8e3-4a92-bae3-49b2d3c51130 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:18.798231 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de110fd6-b8e3-4a92-bae3-49b2d3c51130 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:18.798698 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de110fd6-b8e3-4a92-bae3-49b2d3c51130 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:18.799487 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de110fd6-b8e3-4a92-bae3-49b2d3c51130 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:18.799915 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de110fd6-b8e3-4a92-bae3-49b2d3c51130 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:19.002738 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-de110fd6-b8e3-4a92-bae3-49b2d3c51130 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:19.011049 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-de110fd6-b8e3-4a92-bae3-49b2d3c51130 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1676 microversion: 2.1 time: 0.225314 Feb 28 19:07:19.011637 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 294/599] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:18 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:20.027784 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e8d24501-3e15-4270-bdf0-1cc43116f0cb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:20.028400 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e8d24501-3e15-4270-bdf0-1cc43116f0cb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:20.035631 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e8d24501-3e15-4270-bdf0-1cc43116f0cb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:20.036080 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e8d24501-3e15-4270-bdf0-1cc43116f0cb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:20.036851 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e8d24501-3e15-4270-bdf0-1cc43116f0cb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:20.037290 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e8d24501-3e15-4270-bdf0-1cc43116f0cb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:20.234696 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e8d24501-3e15-4270-bdf0-1cc43116f0cb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:20.242735 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e8d24501-3e15-4270-bdf0-1cc43116f0cb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1653 microversion: 2.1 time: 0.219196 Feb 28 19:07:20.243325 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 306/600] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:20 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1653 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:20.258464 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f658f335-1361-4a4d-9412-44117003d274 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:07:20.265709 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f658f335-1361-4a4d-9412-44117003d274 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:20.266176 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f658f335-1361-4a4d-9412-44117003d274 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:20.320976 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f658f335-1361-4a4d-9412-44117003d274 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Going to try to start instance {{(pid=101792) start /opt/stack/nova/nova/compute/api.py:2625}} Feb 28 19:07:20.565909 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f658f335-1361-4a4d-9412-44117003d274 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "POST /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/action" status: 202 len: 0 microversion: 2.1 time: 0.310917 Feb 28 19:07:20.566501 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 295/601] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:07:20 2022] POST /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:07:20.574829 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-dc7ad138-cebb-44ab-97d5-2aa8b079b4c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:20.575591 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-dc7ad138-cebb-44ab-97d5-2aa8b079b4c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:20.582813 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dc7ad138-cebb-44ab-97d5-2aa8b079b4c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:20.583300 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dc7ad138-cebb-44ab-97d5-2aa8b079b4c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:20.584090 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dc7ad138-cebb-44ab-97d5-2aa8b079b4c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:20.584518 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dc7ad138-cebb-44ab-97d5-2aa8b079b4c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:20.802628 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-dc7ad138-cebb-44ab-97d5-2aa8b079b4c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:20.812368 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-dc7ad138-cebb-44ab-97d5-2aa8b079b4c4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1662 microversion: 2.1 time: 0.241435 Feb 28 19:07:20.815162 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 307/602] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:20 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1662 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:21.832012 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fd1025b1-9785-43db-b13e-5da493e954db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:21.832766 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-fd1025b1-9785-43db-b13e-5da493e954db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:21.840332 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fd1025b1-9785-43db-b13e-5da493e954db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:21.840779 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fd1025b1-9785-43db-b13e-5da493e954db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:21.841538 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fd1025b1-9785-43db-b13e-5da493e954db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:21.841963 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fd1025b1-9785-43db-b13e-5da493e954db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:22.037470 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fd1025b1-9785-43db-b13e-5da493e954db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:22.046561 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-fd1025b1-9785-43db-b13e-5da493e954db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1662 microversion: 2.1 time: 0.218700 Feb 28 19:07:22.047128 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 296/603] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:21 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1662 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:23.064312 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-01e0942c-f0fb-4b69-9568-d03ebc5855f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:23.064928 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-01e0942c-f0fb-4b69-9568-d03ebc5855f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:23.072873 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-01e0942c-f0fb-4b69-9568-d03ebc5855f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:23.073318 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-01e0942c-f0fb-4b69-9568-d03ebc5855f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:23.074085 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-01e0942c-f0fb-4b69-9568-d03ebc5855f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:23.074516 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-01e0942c-f0fb-4b69-9568-d03ebc5855f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:23.268812 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-01e0942c-f0fb-4b69-9568-d03ebc5855f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:23.276923 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-01e0942c-f0fb-4b69-9568-d03ebc5855f2 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1666 microversion: 2.1 time: 0.216257 Feb 28 19:07:23.277481 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 308/604] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:23 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1666 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:31.382925 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0ff264c-44f7-4e38-951f-4edc98ed008f] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 28 19:07:31.386239 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-545275003", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1298881284", "security_groups": [{"name": "tempest-secgroup-smoke-691725167"}], "block_device_mapping_v2": [{"uuid": "3e06d9d5-acd3-4fce-b685-2f933b9a729d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "782279ce-5700-40e2-9c75-fac7ff451ff3"}]}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:07:31.626741 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] validate_networks() for [('782279ce-5700-40e2-9c75-fac7ff451ff3', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:07:32.392424 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0ff264c-44f7-4e38-951f-4edc98ed008f] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 34314. Feb 28 19:07:32.435840 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:07:32.436256 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:07:32.436722 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:07:32.437122 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:07:32.437556 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:07:32.445756 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:32.446691 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:32.447516 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:32.447938 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:32.465069 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Getting quotas for project 90acc320256d4622a351a587d9f604c3. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:07:32.468867 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Getting quotas for user 59f038939b324d9b8e7214cec4e82933 and project 90acc320256d4622a351a587d9f604c3. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:07:32.556151 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:07:32.558313 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e06d9d5-acd3-4fce-b685-2f933b9a729d',volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:07:33.084119 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b103911f-d9db-4fda-a203-a5fba7f0fb1d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.702530 Feb 28 19:07:33.084758 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 297/605] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:07:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:07:33.092415 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: ERROR oslo.messaging._drivers.impl_rabbit [-] [295cd133-f5a7-4657-b76e-4933c04695f5] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 28 19:07:33.095804 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c9b720e2-f998-4a40-9c86-e01bbcd68184 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:33.096438 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c9b720e2-f998-4a40-9c86-e01bbcd68184 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:33.183757 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c9b720e2-f998-4a40-9c86-e01bbcd68184 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:33.191208 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c9b720e2-f998-4a40-9c86-e01bbcd68184 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1094 microversion: 2.1 time: 0.100304 Feb 28 19:07:33.191775 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 309/606] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:33 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:34.208684 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ddc37647-a91c-4ce2-8ec1-43d322797468 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:34.209324 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ddc37647-a91c-4ce2-8ec1-43d322797468 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:34.281822 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ddc37647-a91c-4ce2-8ec1-43d322797468 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:34.289400 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ddc37647-a91c-4ce2-8ec1-43d322797468 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1094 microversion: 2.1 time: 0.084734 Feb 28 19:07:34.290531 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 298/607] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:34 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:35.307048 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-284e7e2a-b690-45a1-8a1f-daabde01f498 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:35.307656 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-284e7e2a-b690-45a1-8a1f-daabde01f498 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:35.317435 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-284e7e2a-b690-45a1-8a1f-daabde01f498 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:35.317880 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-284e7e2a-b690-45a1-8a1f-daabde01f498 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:35.318653 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-284e7e2a-b690-45a1-8a1f-daabde01f498 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:35.319105 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-284e7e2a-b690-45a1-8a1f-daabde01f498 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:35.351776 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] [295cd133-f5a7-4657-b76e-4933c04695f5] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 34342. Feb 28 19:07:35.511366 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-284e7e2a-b690-45a1-8a1f-daabde01f498 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:35.518996 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-284e7e2a-b690-45a1-8a1f-daabde01f498 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1192 microversion: 2.1 time: 0.216422 Feb 28 19:07:35.519583 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 310/608] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:35 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1192 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:36.535900 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4a82fd11-47da-4028-9e40-b2b0f5ea9b04 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:36.536522 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4a82fd11-47da-4028-9e40-b2b0f5ea9b04 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:36.545476 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4a82fd11-47da-4028-9e40-b2b0f5ea9b04 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:36.545921 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4a82fd11-47da-4028-9e40-b2b0f5ea9b04 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:36.546704 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4a82fd11-47da-4028-9e40-b2b0f5ea9b04 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:36.547330 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4a82fd11-47da-4028-9e40-b2b0f5ea9b04 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:36.754216 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4a82fd11-47da-4028-9e40-b2b0f5ea9b04 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:36.764285 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4a82fd11-47da-4028-9e40-b2b0f5ea9b04 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1277 microversion: 2.1 time: 0.232031 Feb 28 19:07:36.767365 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 299/609] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:36 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:37.781346 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-eeaf35a9-92d8-4de5-a416-8f6bf9bdf398 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:37.781953 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-eeaf35a9-92d8-4de5-a416-8f6bf9bdf398 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:37.789521 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eeaf35a9-92d8-4de5-a416-8f6bf9bdf398 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:37.790872 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eeaf35a9-92d8-4de5-a416-8f6bf9bdf398 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:37.791421 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eeaf35a9-92d8-4de5-a416-8f6bf9bdf398 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:37.791959 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eeaf35a9-92d8-4de5-a416-8f6bf9bdf398 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:37.893405 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-749d4b4e-2a46-401a-9cfe-5363dfc650b1 req-82cfe1e1-858e-4ef4-b791-9303aa89b8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629f35f4-df5f-4e49-a667-11c0cc7d7fed", "tag": "570b9152-0452-4bdd-addb-cff2fd1756fd"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:07:37.895063 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:07:37.895063 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:07:37.904434 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-749d4b4e-2a46-401a-9cfe-5363dfc650b1 req-82cfe1e1-858e-4ef4-b791-9303aa89b8c5 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:37.904870 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-749d4b4e-2a46-401a-9cfe-5363dfc650b1 req-82cfe1e1-858e-4ef4-b791-9303aa89b8c5 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:37.924625 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-749d4b4e-2a46-401a-9cfe-5363dfc650b1 req-82cfe1e1-858e-4ef4-b791-9303aa89b8c5 service nova] Creating event network-changed:570b9152-0452-4bdd-addb-cff2fd1756fd for instance 629f35f4-df5f-4e49-a667-11c0cc7d7fed on hv-cinder-83118 Feb 28 19:07:37.929996 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-749d4b4e-2a46-401a-9cfe-5363dfc650b1 req-82cfe1e1-858e-4ef4-b791-9303aa89b8c5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114998 Feb 28 19:07:37.932246 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 300/610] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:07:38.027072 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-eeaf35a9-92d8-4de5-a416-8f6bf9bdf398 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:38.035198 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-eeaf35a9-92d8-4de5-a416-8f6bf9bdf398 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1265 microversion: 2.1 time: 0.257694 Feb 28 19:07:38.035851 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 311/611] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:37 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:07:39.053541 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f27ed850-81af-435b-8939-41f4ee354644 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:39.054236 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f27ed850-81af-435b-8939-41f4ee354644 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:39.063404 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f27ed850-81af-435b-8939-41f4ee354644 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:39.063847 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f27ed850-81af-435b-8939-41f4ee354644 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:39.064667 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f27ed850-81af-435b-8939-41f4ee354644 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:39.065101 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f27ed850-81af-435b-8939-41f4ee354644 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:39.264507 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f27ed850-81af-435b-8939-41f4ee354644 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:39.272604 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f27ed850-81af-435b-8939-41f4ee354644 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1265 microversion: 2.1 time: 0.223153 Feb 28 19:07:39.273173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 301/612] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:39 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:07:40.289574 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ba88be1a-95d1-4395-bdbe-6a5270ba366e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:40.290135 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ba88be1a-95d1-4395-bdbe-6a5270ba366e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:40.297539 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ba88be1a-95d1-4395-bdbe-6a5270ba366e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:40.297986 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ba88be1a-95d1-4395-bdbe-6a5270ba366e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:40.298751 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ba88be1a-95d1-4395-bdbe-6a5270ba366e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:40.299228 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ba88be1a-95d1-4395-bdbe-6a5270ba366e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:40.490448 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ba88be1a-95d1-4395-bdbe-6a5270ba366e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:40.498974 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ba88be1a-95d1-4395-bdbe-6a5270ba366e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1265 microversion: 2.1 time: 0.213439 Feb 28 19:07:40.499762 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 312/613] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:40 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:41.515501 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e0b0138b-ed9b-4196-939c-2b022f0769f4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:41.516125 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e0b0138b-ed9b-4196-939c-2b022f0769f4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:41.523521 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e0b0138b-ed9b-4196-939c-2b022f0769f4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:41.524791 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e0b0138b-ed9b-4196-939c-2b022f0769f4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:41.525735 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e0b0138b-ed9b-4196-939c-2b022f0769f4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:41.526116 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e0b0138b-ed9b-4196-939c-2b022f0769f4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:41.727977 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e0b0138b-ed9b-4196-939c-2b022f0769f4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:41.736268 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e0b0138b-ed9b-4196-939c-2b022f0769f4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1265 microversion: 2.1 time: 0.224394 Feb 28 19:07:41.736826 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 302/614] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:41 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:42.753523 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a777ec3f-bb2e-40f5-bc4f-d559cac1f408 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:42.754114 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a777ec3f-bb2e-40f5-bc4f-d559cac1f408 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:42.761837 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a777ec3f-bb2e-40f5-bc4f-d559cac1f408 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:42.762280 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a777ec3f-bb2e-40f5-bc4f-d559cac1f408 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:42.763045 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a777ec3f-bb2e-40f5-bc4f-d559cac1f408 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:42.763510 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a777ec3f-bb2e-40f5-bc4f-d559cac1f408 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:42.978740 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a777ec3f-bb2e-40f5-bc4f-d559cac1f408 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:42.987181 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a777ec3f-bb2e-40f5-bc4f-d559cac1f408 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1265 microversion: 2.1 time: 0.237032 Feb 28 19:07:42.987479 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 313/615] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:42 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:43.371372 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-26b44eef-fbaf-4d12-9255-bbac58c17ef7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:43.371859 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-26b44eef-fbaf-4d12-9255-bbac58c17ef7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:43.378955 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-26b44eef-fbaf-4d12-9255-bbac58c17ef7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:43.379438 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-26b44eef-fbaf-4d12-9255-bbac58c17ef7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:43.380203 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-26b44eef-fbaf-4d12-9255-bbac58c17ef7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:43.380636 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-26b44eef-fbaf-4d12-9255-bbac58c17ef7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:43.444712 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-26b44eef-fbaf-4d12-9255-bbac58c17ef7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments/495ace31-bcb1-4621-95db-4f663b83e570" status: 200 len: 194 microversion: 2.20 time: 0.192077 Feb 28 19:07:43.445275 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 303/616] 10.222.0.21 () {60 vars in 1453 bytes} [Mon Feb 28 19:07:43 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments/495ace31-bcb1-4621-95db-4f663b83e570 => generated 194 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 19:07:43.542085 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-953ac75b-d426-42bc-93e7-ea0a732b97ac tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:43.542394 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-953ac75b-d426-42bc-93e7-ea0a732b97ac tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:43.549808 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-953ac75b-d426-42bc-93e7-ea0a732b97ac tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:43.550275 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-953ac75b-d426-42bc-93e7-ea0a732b97ac tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:43.551064 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-953ac75b-d426-42bc-93e7-ea0a732b97ac tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:43.551527 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-953ac75b-d426-42bc-93e7-ea0a732b97ac tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:43.729049 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-953ac75b-d426-42bc-93e7-ea0a732b97ac tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lazy-loading 'services' on Instance uuid 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:07:44.004039 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-3db075a5-a009-4fe3-a9b8-75f9a7bf6e13 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:44.011668 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3db075a5-a009-4fe3-a9b8-75f9a7bf6e13 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:44.012065 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3db075a5-a009-4fe3-a9b8-75f9a7bf6e13 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:44.012509 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3db075a5-a009-4fe3-a9b8-75f9a7bf6e13 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:44.013284 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3db075a5-a009-4fe3-a9b8-75f9a7bf6e13 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:44.013705 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3db075a5-a009-4fe3-a9b8-75f9a7bf6e13 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:44.173705 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-953ac75b-d426-42bc-93e7-ea0a732b97ac tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments/495ace31-bcb1-4621-95db-4f663b83e570" status: 202 len: 0 microversion: 2.20 time: 0.636642 Feb 28 19:07:44.174830 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 314/617] 10.222.0.21 () {60 vars in 1456 bytes} [Mon Feb 28 19:07:43 2022] DELETE /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments/495ace31-bcb1-4621-95db-4f663b83e570 => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:07:44.184441 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e5b2df95-842f-4294-9b95-837162c3147a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:44.185625 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e5b2df95-842f-4294-9b95-837162c3147a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:44.193336 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e5b2df95-842f-4294-9b95-837162c3147a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:44.193716 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e5b2df95-842f-4294-9b95-837162c3147a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:44.194569 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e5b2df95-842f-4294-9b95-837162c3147a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:44.195021 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e5b2df95-842f-4294-9b95-837162c3147a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:44.213669 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-3db075a5-a009-4fe3-a9b8-75f9a7bf6e13 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:44.221709 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-3db075a5-a009-4fe3-a9b8-75f9a7bf6e13 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1265 microversion: 2.1 time: 0.221328 Feb 28 19:07:44.222591 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 304/618] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:43 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:07:44.263625 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e5b2df95-842f-4294-9b95-837162c3147a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083355 Feb 28 19:07:44.264195 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 315/619] 10.222.0.21 () {60 vars in 1342 bytes} [Mon Feb 28 19:07:44 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 19:07:45.240085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-764aa3ed-a506-4ec6-8fda-abef5c0d9ff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:45.240720 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-764aa3ed-a506-4ec6-8fda-abef5c0d9ff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:45.249258 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-764aa3ed-a506-4ec6-8fda-abef5c0d9ff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:45.249616 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-764aa3ed-a506-4ec6-8fda-abef5c0d9ff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:45.250393 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-764aa3ed-a506-4ec6-8fda-abef5c0d9ff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:45.250827 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-764aa3ed-a506-4ec6-8fda-abef5c0d9ff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:45.275498 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9ffcdd14-c6cd-4088-9428-8e9d6e5c76be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:45.276442 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9ffcdd14-c6cd-4088-9428-8e9d6e5c76be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:45.284055 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ffcdd14-c6cd-4088-9428-8e9d6e5c76be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:45.284626 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ffcdd14-c6cd-4088-9428-8e9d6e5c76be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:45.285402 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ffcdd14-c6cd-4088-9428-8e9d6e5c76be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:45.285826 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9ffcdd14-c6cd-4088-9428-8e9d6e5c76be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:45.356831 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9ffcdd14-c6cd-4088-9428-8e9d6e5c76be tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085173 Feb 28 19:07:45.357384 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 316/620] 10.222.0.21 () {60 vars in 1342 bytes} [Mon Feb 28 19:07:45 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 19:07:45.457246 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-764aa3ed-a506-4ec6-8fda-abef5c0d9ff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:45.466585 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-764aa3ed-a506-4ec6-8fda-abef5c0d9ff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1265 microversion: 2.1 time: 0.230169 Feb 28 19:07:45.467170 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 305/621] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:45 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:46.368509 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2fea985f-51f6-4e31-b710-e3b832e01a43 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:46.369342 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-2fea985f-51f6-4e31-b710-e3b832e01a43 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:46.376511 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2fea985f-51f6-4e31-b710-e3b832e01a43 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:46.376952 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2fea985f-51f6-4e31-b710-e3b832e01a43 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:46.377709 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2fea985f-51f6-4e31-b710-e3b832e01a43 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:46.378136 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2fea985f-51f6-4e31-b710-e3b832e01a43 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:46.441892 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2fea985f-51f6-4e31-b710-e3b832e01a43 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.077344 Feb 28 19:07:46.442428 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 317/622] 10.222.0.21 () {60 vars in 1342 bytes} [Mon Feb 28 19:07:46 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:46.483827 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a8981011-e569-4dc1-9874-77b07e74e661 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:46.484548 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a8981011-e569-4dc1-9874-77b07e74e661 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:46.491901 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a8981011-e569-4dc1-9874-77b07e74e661 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:46.492417 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a8981011-e569-4dc1-9874-77b07e74e661 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:46.493301 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a8981011-e569-4dc1-9874-77b07e74e661 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:46.493818 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a8981011-e569-4dc1-9874-77b07e74e661 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:46.533846 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e3a8ceae-f96d-4562-80d8-b448d724e045 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:46.534343 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e3a8ceae-f96d-4562-80d8-b448d724e045 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:46.542541 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e3a8ceae-f96d-4562-80d8-b448d724e045 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:46.542989 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e3a8ceae-f96d-4562-80d8-b448d724e045 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:46.543796 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e3a8ceae-f96d-4562-80d8-b448d724e045 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:46.544229 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e3a8ceae-f96d-4562-80d8-b448d724e045 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:46.603778 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e3a8ceae-f96d-4562-80d8-b448d724e045 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Going to try to terminate instance {{(pid=101791) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:07:46.690483 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a8981011-e569-4dc1-9874-77b07e74e661 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:46.699486 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a8981011-e569-4dc1-9874-77b07e74e661 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1265 microversion: 2.1 time: 0.219379 Feb 28 19:07:46.700044 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 306/623] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:46 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:46.951288 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e3a8ceae-f96d-4562-80d8-b448d724e045 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 204 len: 0 microversion: 2.20 time: 0.420587 Feb 28 19:07:46.952083 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 318/624] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Feb 28 19:07:46 2022] DELETE /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 28 19:07:46.960431 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fbd52c57-96b3-4efc-954a-889aece50f96 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:46.961736 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-fbd52c57-96b3-4efc-954a-889aece50f96 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:46.969814 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fbd52c57-96b3-4efc-954a-889aece50f96 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:46.970555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fbd52c57-96b3-4efc-954a-889aece50f96 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:46.971634 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fbd52c57-96b3-4efc-954a-889aece50f96 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:46.972530 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fbd52c57-96b3-4efc-954a-889aece50f96 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:47.170102 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fbd52c57-96b3-4efc-954a-889aece50f96 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:47.178554 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fbd52c57-96b3-4efc-954a-889aece50f96 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:47.180604 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fbd52c57-96b3-4efc-954a-889aece50f96 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:47.181723 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-fbd52c57-96b3-4efc-954a-889aece50f96 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.225356 Feb 28 19:07:47.182274 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 307/625] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:07:46 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:07:47.717488 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7772a606-4508-4ac3-91bd-c594f8e2cafc tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:47.718229 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7772a606-4508-4ac3-91bd-c594f8e2cafc tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:47.725582 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7772a606-4508-4ac3-91bd-c594f8e2cafc tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:47.726045 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7772a606-4508-4ac3-91bd-c594f8e2cafc tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:47.726828 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7772a606-4508-4ac3-91bd-c594f8e2cafc tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:47.728594 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7772a606-4508-4ac3-91bd-c594f8e2cafc tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:47.928386 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7772a606-4508-4ac3-91bd-c594f8e2cafc tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:47.936670 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7772a606-4508-4ac3-91bd-c594f8e2cafc tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1265 microversion: 2.1 time: 0.223366 Feb 28 19:07:47.937226 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 319/626] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:47 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:48.201032 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f59abb31-51ee-4196-936b-f6f1eb8fd47c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:48.201645 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f59abb31-51ee-4196-936b-f6f1eb8fd47c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:48.209317 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f59abb31-51ee-4196-936b-f6f1eb8fd47c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:48.209767 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f59abb31-51ee-4196-936b-f6f1eb8fd47c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:48.210536 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f59abb31-51ee-4196-936b-f6f1eb8fd47c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:48.211024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f59abb31-51ee-4196-936b-f6f1eb8fd47c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:48.416006 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f59abb31-51ee-4196-936b-f6f1eb8fd47c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:48.424549 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f59abb31-51ee-4196-936b-f6f1eb8fd47c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:48.426014 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f59abb31-51ee-4196-936b-f6f1eb8fd47c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:48.427138 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f59abb31-51ee-4196-936b-f6f1eb8fd47c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.229872 Feb 28 19:07:48.427686 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 308/627] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:07:48 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:07:48.953690 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-dbb1ab5b-47df-4889-9d7f-e386e9d692f2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:48.954302 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-dbb1ab5b-47df-4889-9d7f-e386e9d692f2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:48.961913 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dbb1ab5b-47df-4889-9d7f-e386e9d692f2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:48.972233 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dbb1ab5b-47df-4889-9d7f-e386e9d692f2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:48.972233 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dbb1ab5b-47df-4889-9d7f-e386e9d692f2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:48.972233 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dbb1ab5b-47df-4889-9d7f-e386e9d692f2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:49.168751 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-dbb1ab5b-47df-4889-9d7f-e386e9d692f2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:49.177126 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-dbb1ab5b-47df-4889-9d7f-e386e9d692f2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1265 microversion: 2.1 time: 0.227199 Feb 28 19:07:49.177682 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 320/628] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:48 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:49.250731 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-351c7465-70f8-45d7-b6ce-8add31761082 req-4493114d-9c63-413e-b907-178179f33781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629f35f4-df5f-4e49-a667-11c0cc7d7fed", "name": "network-vif-plugged", "status": "completed", "tag": "570b9152-0452-4bdd-addb-cff2fd1756fd"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:07:49.252328 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:07:49.252328 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:07:49.260803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-351c7465-70f8-45d7-b6ce-8add31761082 req-4493114d-9c63-413e-b907-178179f33781 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:49.261247 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-351c7465-70f8-45d7-b6ce-8add31761082 req-4493114d-9c63-413e-b907-178179f33781 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:49.277480 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-351c7465-70f8-45d7-b6ce-8add31761082 req-4493114d-9c63-413e-b907-178179f33781 service nova] Creating event network-vif-plugged:570b9152-0452-4bdd-addb-cff2fd1756fd for instance 629f35f4-df5f-4e49-a667-11c0cc7d7fed on hv-cinder-83118 Feb 28 19:07:49.282385 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-351c7465-70f8-45d7-b6ce-8add31761082 req-4493114d-9c63-413e-b907-178179f33781 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086389 Feb 28 19:07:49.283239 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 309/629] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:07:49.445805 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-14f6346e-390e-452d-a25b-19e100e749a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:49.446782 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-14f6346e-390e-452d-a25b-19e100e749a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:49.454035 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-14f6346e-390e-452d-a25b-19e100e749a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:49.454478 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-14f6346e-390e-452d-a25b-19e100e749a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:49.455265 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-14f6346e-390e-452d-a25b-19e100e749a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:49.455720 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-14f6346e-390e-452d-a25b-19e100e749a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:49.657008 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-14f6346e-390e-452d-a25b-19e100e749a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:49.666808 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-14f6346e-390e-452d-a25b-19e100e749a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:49.668457 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-14f6346e-390e-452d-a25b-19e100e749a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:49.669696 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-14f6346e-390e-452d-a25b-19e100e749a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1726 microversion: 2.20 time: 0.227772 Feb 28 19:07:49.670460 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 321/630] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:07:49 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1726 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:07:50.194412 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8abc6958-7ccd-4fa9-8cfc-07ff4d13f4c9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:50.195185 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8abc6958-7ccd-4fa9-8cfc-07ff4d13f4c9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:50.203455 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8abc6958-7ccd-4fa9-8cfc-07ff4d13f4c9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:50.204125 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8abc6958-7ccd-4fa9-8cfc-07ff4d13f4c9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:50.204900 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8abc6958-7ccd-4fa9-8cfc-07ff4d13f4c9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:50.205334 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8abc6958-7ccd-4fa9-8cfc-07ff4d13f4c9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:50.409238 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8abc6958-7ccd-4fa9-8cfc-07ff4d13f4c9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:50.418431 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8abc6958-7ccd-4fa9-8cfc-07ff4d13f4c9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1265 microversion: 2.1 time: 0.228175 Feb 28 19:07:50.419450 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 310/631] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:50 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:50.510551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-bd62750a-f7ef-45ec-852c-21a8fee48bd5 req-58a6506a-5724-4e33-96b6-5b349b9d4af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70", "name": "network-vif-deleted", "tag": "7caa3a37-72ae-4e36-90cf-0f518cb19c37"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:07:50.512395 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:07:50.512395 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:07:50.521038 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-bd62750a-f7ef-45ec-852c-21a8fee48bd5 req-58a6506a-5724-4e33-96b6-5b349b9d4af2 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:50.521485 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-bd62750a-f7ef-45ec-852c-21a8fee48bd5 req-58a6506a-5724-4e33-96b6-5b349b9d4af2 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:50.539325 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-bd62750a-f7ef-45ec-852c-21a8fee48bd5 req-58a6506a-5724-4e33-96b6-5b349b9d4af2 service nova] Creating event network-vif-deleted:7caa3a37-72ae-4e36-90cf-0f518cb19c37 for instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 on hv-cinder-83118 Feb 28 19:07:50.545211 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-bd62750a-f7ef-45ec-852c-21a8fee48bd5 req-58a6506a-5724-4e33-96b6-5b349b9d4af2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040210 Feb 28 19:07:50.545800 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 322/632] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:07:50.688917 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ab916aa0-68b9-4246-b697-0417394f469c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:50.689835 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ab916aa0-68b9-4246-b697-0417394f469c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:50.698492 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ab916aa0-68b9-4246-b697-0417394f469c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:50.699296 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ab916aa0-68b9-4246-b697-0417394f469c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:50.700255 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ab916aa0-68b9-4246-b697-0417394f469c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:50.700852 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ab916aa0-68b9-4246-b697-0417394f469c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:50.824894 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ab916aa0-68b9-4246-b697-0417394f469c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:50.834571 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ab916aa0-68b9-4246-b697-0417394f469c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:50.836624 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ab916aa0-68b9-4246-b697-0417394f469c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:50.837819 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ab916aa0-68b9-4246-b697-0417394f469c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 200 len: 1367 microversion: 2.20 time: 0.153223 Feb 28 19:07:50.838458 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 311/633] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:07:50 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:07:51.436891 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9943f0fe-a016-43b3-9980-bf1b606b4219 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:51.437640 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9943f0fe-a016-43b3-9980-bf1b606b4219 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:51.447345 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9943f0fe-a016-43b3-9980-bf1b606b4219 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:51.447850 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9943f0fe-a016-43b3-9980-bf1b606b4219 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:51.449071 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9943f0fe-a016-43b3-9980-bf1b606b4219 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:51.449501 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9943f0fe-a016-43b3-9980-bf1b606b4219 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:51.759034 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9943f0fe-a016-43b3-9980-bf1b606b4219 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:51.767377 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9943f0fe-a016-43b3-9980-bf1b606b4219 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1452 microversion: 2.1 time: 0.335491 Feb 28 19:07:51.767948 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 323/634] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:51 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1452 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:51.784016 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b91084b2-6158-48df-b276-1af5ee9eaf4d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:51.784924 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b91084b2-6158-48df-b276-1af5ee9eaf4d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:51.793285 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b91084b2-6158-48df-b276-1af5ee9eaf4d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:51.793826 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b91084b2-6158-48df-b276-1af5ee9eaf4d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:51.794753 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b91084b2-6158-48df-b276-1af5ee9eaf4d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:51.795298 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b91084b2-6158-48df-b276-1af5ee9eaf4d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:51.857482 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1bc44b05-ade5-42f4-ba48-3947ac22d682 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:51.892795 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1bc44b05-ade5-42f4-ba48-3947ac22d682 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:51.892795 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1bc44b05-ade5-42f4-ba48-3947ac22d682 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:51.892795 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1bc44b05-ade5-42f4-ba48-3947ac22d682 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:51.892795 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1bc44b05-ade5-42f4-ba48-3947ac22d682 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:51.893212 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1bc44b05-ade5-42f4-ba48-3947ac22d682 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:51.937993 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-1bc44b05-ade5-42f4-ba48-3947ac22d682 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] HTTP exception thrown: Instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 could not be found. Feb 28 19:07:51.938667 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1bc44b05-ade5-42f4-ba48-3947ac22d682 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Returning 404 to user: Instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:07:51.939816 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1bc44b05-ade5-42f4-ba48-3947ac22d682 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 404 len: 111 microversion: 2.20 time: 0.086947 Feb 28 19:07:51.940577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 324/635] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:07:51 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 28 19:07:51.950717 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-3ecbcc3f-2f6c-4ca7-bb61-e0ecd1f0f4ea tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '.version_select at 0x7f912f896ca0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:52.051879 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b91084b2-6158-48df-b276-1af5ee9eaf4d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:52.060963 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b91084b2-6158-48df-b276-1af5ee9eaf4d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1452 microversion: 2.1 time: 0.280777 Feb 28 19:07:52.061597 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 312/636] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:07:51 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1452 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:07:52.103395 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-3ecbcc3f-2f6c-4ca7-bb61-e0ecd1f0f4ea tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1829096883" status: 204 len: 0 microversion: 2.20 time: 0.156526 Feb 28 19:07:52.108180 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 325/637] 10.222.0.21 () {60 vars in 1261 bytes} [Mon Feb 28 19:07:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1829096883 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 28 19:07:53.529408 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e20fc42e-eef2-4197-87a8-680261907821 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Action: 'create', calling method: .version_select at 0x7f912e2a9040>, body: {"keypair": {"name": "tempest-keypair-1174504884"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:07:53.551427 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-e20fc42e-eef2-4197-87a8-680261907821 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:07:53.555803 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-e20fc42e-eef2-4197-87a8-680261907821 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for user b9371804d1f943a6b6b3b2a9901030c8 and project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:07:53.694755 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-e20fc42e-eef2-4197-87a8-680261907821 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:07:53.699575 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-e20fc42e-eef2-4197-87a8-680261907821 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for user b9371804d1f943a6b6b3b2a9901030c8 and project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:07:53.712973 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e20fc42e-eef2-4197-87a8-680261907821 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.187216 Feb 28 19:07:53.713585 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 313/638] 10.222.0.21 () {62 vars in 1198 bytes} [Mon Feb 28 19:07:53 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 28 19:07:55.305889 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-ab9c7227-74f8-4566-ab57-b3ca11990092 req-a57089a5-b9e1-4041-a702-367ddf0eda8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629f35f4-df5f-4e49-a667-11c0cc7d7fed", "tag": "570b9152-0452-4bdd-addb-cff2fd1756fd"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:07:55.311283 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:07:55.311283 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:07:55.316354 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-ab9c7227-74f8-4566-ab57-b3ca11990092 req-a57089a5-b9e1-4041-a702-367ddf0eda8d service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:55.316799 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-ab9c7227-74f8-4566-ab57-b3ca11990092 req-a57089a5-b9e1-4041-a702-367ddf0eda8d service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:55.332648 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-ab9c7227-74f8-4566-ab57-b3ca11990092 req-a57089a5-b9e1-4041-a702-367ddf0eda8d service nova] Creating event network-changed:570b9152-0452-4bdd-addb-cff2fd1756fd for instance 629f35f4-df5f-4e49-a667-11c0cc7d7fed on hv-cinder-83118 Feb 28 19:07:55.338120 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-ab9c7227-74f8-4566-ab57-b3ca11990092 req-a57089a5-b9e1-4041-a702-367ddf0eda8d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089919 Feb 28 19:07:55.338901 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 326/639] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:07:56.875823 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-320214550", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "099c77b0-b32f-4f92-b4b4-e414371a1e31"}], "security_groups": [{"name": "tempest-securitygroup--1354265167"}], "key_name": "tempest-keypair-1174504884", "user_data": "}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:07:57.043764 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] validate_networks() for [('099c77b0-b32f-4f92-b4b4-e414371a1e31', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:07:57.559417 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:07:57.559844 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:07:57.560323 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:07:57.560731 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:07:57.561142 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:07:57.569386 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:57.569829 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:57.570656 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:57.571086 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:57.588331 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:07:57.592240 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Getting quotas for user b9371804d1f943a6b6b3b2a9901030c8 and project a73fa98b1d974ed1935c4d3e2879abad. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:07:57.603373 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:07:57.605637 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:07:57.752355 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8e213162-7b62-4f8e-bff9-b868c27bc508 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.880744 Feb 28 19:07:57.752931 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 314/640] 10.222.0.21 () {62 vars in 1187 bytes} [Mon Feb 28 19:07:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 28 19:07:57.763605 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9f183e3d-dfaf-4ce1-b417-714c429160dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:57.764415 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9f183e3d-dfaf-4ce1-b417-714c429160dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:57.838806 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9f183e3d-dfaf-4ce1-b417-714c429160dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:57.846851 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9f183e3d-dfaf-4ce1-b417-714c429160dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:57.848386 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9f183e3d-dfaf-4ce1-b417-714c429160dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:57.849440 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9f183e3d-dfaf-4ce1-b417-714c429160dd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1281 microversion: 2.20 time: 0.090117 Feb 28 19:07:57.849968 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 327/641] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:07:57 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:07:58.866894 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0bd680cb-0972-413c-bdf8-6ddc493f33e1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:07:58.868331 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0bd680cb-0972-413c-bdf8-6ddc493f33e1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:07:58.875812 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0bd680cb-0972-413c-bdf8-6ddc493f33e1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:58.876257 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0bd680cb-0972-413c-bdf8-6ddc493f33e1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:58.877015 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0bd680cb-0972-413c-bdf8-6ddc493f33e1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:07:58.877440 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0bd680cb-0972-413c-bdf8-6ddc493f33e1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:07:58.991094 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0bd680cb-0972-413c-bdf8-6ddc493f33e1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:58.999855 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0bd680cb-0972-413c-bdf8-6ddc493f33e1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:59.001395 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0bd680cb-0972-413c-bdf8-6ddc493f33e1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:07:59.002460 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0bd680cb-0972-413c-bdf8-6ddc493f33e1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1277 microversion: 2.20 time: 0.139326 Feb 28 19:07:59.003013 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 315/642] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:07:58 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:08:00.019930 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ffcf9e78-bdaf-4ba3-bea1-9d0bf23d8d9d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:00.020541 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ffcf9e78-bdaf-4ba3-bea1-9d0bf23d8d9d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:00.028374 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ffcf9e78-bdaf-4ba3-bea1-9d0bf23d8d9d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:00.028813 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ffcf9e78-bdaf-4ba3-bea1-9d0bf23d8d9d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:00.029577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ffcf9e78-bdaf-4ba3-bea1-9d0bf23d8d9d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:00.030007 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ffcf9e78-bdaf-4ba3-bea1-9d0bf23d8d9d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:00.144762 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ffcf9e78-bdaf-4ba3-bea1-9d0bf23d8d9d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:00.153836 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ffcf9e78-bdaf-4ba3-bea1-9d0bf23d8d9d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:00.155801 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ffcf9e78-bdaf-4ba3-bea1-9d0bf23d8d9d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:00.156878 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ffcf9e78-bdaf-4ba3-bea1-9d0bf23d8d9d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1339 microversion: 2.20 time: 0.140724 Feb 28 19:08:00.157427 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 328/643] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:08:00 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1339 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:08:01.179125 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e8007e27-a03f-49b6-9ab5-0480e3942e13 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:01.180262 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e8007e27-a03f-49b6-9ab5-0480e3942e13 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:01.187577 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e8007e27-a03f-49b6-9ab5-0480e3942e13 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:01.188018 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e8007e27-a03f-49b6-9ab5-0480e3942e13 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:01.188775 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e8007e27-a03f-49b6-9ab5-0480e3942e13 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:01.189204 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e8007e27-a03f-49b6-9ab5-0480e3942e13 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:01.388219 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e8007e27-a03f-49b6-9ab5-0480e3942e13 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:01.396704 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e8007e27-a03f-49b6-9ab5-0480e3942e13 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:01.398217 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e8007e27-a03f-49b6-9ab5-0480e3942e13 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:01.399313 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e8007e27-a03f-49b6-9ab5-0480e3942e13 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1407 microversion: 2.20 time: 0.223922 Feb 28 19:08:01.399874 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 316/644] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:08:01 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:08:01.906461 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-7efef024-6823-4b93-9ab7-04b480a5b954 req-182b9aa7-1d9b-4816-b930-56f04d5c2927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aea8cac-d69e-4467-9c2e-d38652fbf89f", "tag": "29a481fd-7c99-42e1-92d5-26fb61661a7d"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:08:01.907989 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:08:01.907989 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:08:01.918991 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-7efef024-6823-4b93-9ab7-04b480a5b954 req-182b9aa7-1d9b-4816-b930-56f04d5c2927 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:01.919464 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-7efef024-6823-4b93-9ab7-04b480a5b954 req-182b9aa7-1d9b-4816-b930-56f04d5c2927 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:01.936124 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-7efef024-6823-4b93-9ab7-04b480a5b954 req-182b9aa7-1d9b-4816-b930-56f04d5c2927 service nova] Creating event network-changed:29a481fd-7c99-42e1-92d5-26fb61661a7d for instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f on hv-cinder-83118 Feb 28 19:08:01.940623 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-7efef024-6823-4b93-9ab7-04b480a5b954 req-182b9aa7-1d9b-4816-b930-56f04d5c2927 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038858 Feb 28 19:08:01.941217 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 329/645] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:08:02.417702 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-138e49af-9b5b-438f-badf-8aebca54ca52 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:02.418318 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-138e49af-9b5b-438f-badf-8aebca54ca52 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:02.425387 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-138e49af-9b5b-438f-badf-8aebca54ca52 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:02.425833 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-138e49af-9b5b-438f-badf-8aebca54ca52 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:02.426599 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-138e49af-9b5b-438f-badf-8aebca54ca52 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:02.427033 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-138e49af-9b5b-438f-badf-8aebca54ca52 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:02.638191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-138e49af-9b5b-438f-badf-8aebca54ca52 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:02.647197 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-138e49af-9b5b-438f-badf-8aebca54ca52 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:02.654085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-138e49af-9b5b-438f-badf-8aebca54ca52 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:02.654085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-138e49af-9b5b-438f-badf-8aebca54ca52 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1407 microversion: 2.20 time: 0.237006 Feb 28 19:08:02.654085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 317/646] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:08:02 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:08:03.669711 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f0be1992-808d-46cc-bb98-aef44555297f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:03.670401 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f0be1992-808d-46cc-bb98-aef44555297f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:03.677812 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f0be1992-808d-46cc-bb98-aef44555297f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:03.678251 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f0be1992-808d-46cc-bb98-aef44555297f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:03.679009 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f0be1992-808d-46cc-bb98-aef44555297f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:03.679476 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f0be1992-808d-46cc-bb98-aef44555297f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:03.877569 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f0be1992-808d-46cc-bb98-aef44555297f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:03.886581 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f0be1992-808d-46cc-bb98-aef44555297f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:03.888091 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f0be1992-808d-46cc-bb98-aef44555297f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:03.889140 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f0be1992-808d-46cc-bb98-aef44555297f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1407 microversion: 2.20 time: 0.223765 Feb 28 19:08:03.889806 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 330/647] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:08:03 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:08:04.907841 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b485283b-1de9-4cce-8fb2-bfa5d1353bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:04.908449 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b485283b-1de9-4cce-8fb2-bfa5d1353bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:04.917445 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b485283b-1de9-4cce-8fb2-bfa5d1353bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:04.917906 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b485283b-1de9-4cce-8fb2-bfa5d1353bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:04.919038 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b485283b-1de9-4cce-8fb2-bfa5d1353bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:04.920000 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b485283b-1de9-4cce-8fb2-bfa5d1353bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:05.212256 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b485283b-1de9-4cce-8fb2-bfa5d1353bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:05.217725 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b485283b-1de9-4cce-8fb2-bfa5d1353bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:05.219247 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b485283b-1de9-4cce-8fb2-bfa5d1353bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:05.220313 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b485283b-1de9-4cce-8fb2-bfa5d1353bd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1407 microversion: 2.20 time: 0.316224 Feb 28 19:08:05.220866 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 318/648] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:08:04 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:08:06.238729 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-adf950c8-fa14-4adf-8303-c3c3edfe3e6a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:06.239354 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-adf950c8-fa14-4adf-8303-c3c3edfe3e6a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:06.246573 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-adf950c8-fa14-4adf-8303-c3c3edfe3e6a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:06.247016 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-adf950c8-fa14-4adf-8303-c3c3edfe3e6a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:06.247802 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-adf950c8-fa14-4adf-8303-c3c3edfe3e6a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:06.248239 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-adf950c8-fa14-4adf-8303-c3c3edfe3e6a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:06.437716 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-adf950c8-fa14-4adf-8303-c3c3edfe3e6a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:06.446895 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-adf950c8-fa14-4adf-8303-c3c3edfe3e6a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:06.448426 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-adf950c8-fa14-4adf-8303-c3c3edfe3e6a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:06.449492 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-adf950c8-fa14-4adf-8303-c3c3edfe3e6a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1407 microversion: 2.20 time: 0.214538 Feb 28 19:08:06.450043 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 331/649] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:08:06 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:08:07.219506 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-3bb861c2-5761-468a-8fd1-f6432c2536ef req-54161394-6ecc-4ddf-82d6-39630b669a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aea8cac-d69e-4467-9c2e-d38652fbf89f", "name": "network-vif-plugged", "status": "completed", "tag": "29a481fd-7c99-42e1-92d5-26fb61661a7d"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:08:07.221076 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:08:07.221076 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:08:07.230033 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-3bb861c2-5761-468a-8fd1-f6432c2536ef req-54161394-6ecc-4ddf-82d6-39630b669a2e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:07.230474 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-3bb861c2-5761-468a-8fd1-f6432c2536ef req-54161394-6ecc-4ddf-82d6-39630b669a2e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:07.246555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-3bb861c2-5761-468a-8fd1-f6432c2536ef req-54161394-6ecc-4ddf-82d6-39630b669a2e service nova] Creating event network-vif-plugged:29a481fd-7c99-42e1-92d5-26fb61661a7d for instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f on hv-cinder-83118 Feb 28 19:08:07.251428 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-3bb861c2-5761-468a-8fd1-f6432c2536ef req-54161394-6ecc-4ddf-82d6-39630b669a2e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035515 Feb 28 19:08:07.252069 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 319/650] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:08:07.466992 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-873801ee-4cdd-4eff-b5da-3af37457bfe2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:07.468253 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-873801ee-4cdd-4eff-b5da-3af37457bfe2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:07.475458 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-873801ee-4cdd-4eff-b5da-3af37457bfe2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:07.475905 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-873801ee-4cdd-4eff-b5da-3af37457bfe2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:07.483309 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-873801ee-4cdd-4eff-b5da-3af37457bfe2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:07.483309 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-873801ee-4cdd-4eff-b5da-3af37457bfe2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:07.679281 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-873801ee-4cdd-4eff-b5da-3af37457bfe2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:07.688116 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-873801ee-4cdd-4eff-b5da-3af37457bfe2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:07.689601 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-873801ee-4cdd-4eff-b5da-3af37457bfe2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:07.690662 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-873801ee-4cdd-4eff-b5da-3af37457bfe2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1407 microversion: 2.20 time: 0.227521 Feb 28 19:08:07.691229 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 332/651] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:08:07 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:08:08.709599 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c257461e-c7b4-4136-bbf3-281772ec5fc4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:08.710314 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c257461e-c7b4-4136-bbf3-281772ec5fc4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:08.718231 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c257461e-c7b4-4136-bbf3-281772ec5fc4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:08.718674 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c257461e-c7b4-4136-bbf3-281772ec5fc4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:08.719525 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c257461e-c7b4-4136-bbf3-281772ec5fc4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:08.719960 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c257461e-c7b4-4136-bbf3-281772ec5fc4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:08.925491 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c257461e-c7b4-4136-bbf3-281772ec5fc4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:08.936370 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c257461e-c7b4-4136-bbf3-281772ec5fc4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:08.937860 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c257461e-c7b4-4136-bbf3-281772ec5fc4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:08.938940 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c257461e-c7b4-4136-bbf3-281772ec5fc4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1407 microversion: 2.20 time: 0.233863 Feb 28 19:08:08.939711 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 320/652] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:08:08 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:08:09.957139 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-00aea59b-6f7b-4116-9d8f-4f89825b0f26 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:09.957749 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-00aea59b-6f7b-4116-9d8f-4f89825b0f26 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:09.965835 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-00aea59b-6f7b-4116-9d8f-4f89825b0f26 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:09.966280 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-00aea59b-6f7b-4116-9d8f-4f89825b0f26 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:09.967049 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-00aea59b-6f7b-4116-9d8f-4f89825b0f26 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:09.967511 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-00aea59b-6f7b-4116-9d8f-4f89825b0f26 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:10.160506 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-00aea59b-6f7b-4116-9d8f-4f89825b0f26 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:10.170320 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-00aea59b-6f7b-4116-9d8f-4f89825b0f26 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:10.171839 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-00aea59b-6f7b-4116-9d8f-4f89825b0f26 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:10.172938 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-00aea59b-6f7b-4116-9d8f-4f89825b0f26 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1600 microversion: 2.20 time: 0.219548 Feb 28 19:08:10.173477 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 333/653] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:08:09 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:08:10.190174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e2433a3f-7f3d-4f31-bd9e-85ffbd042b54 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:10.195173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e2433a3f-7f3d-4f31-bd9e-85ffbd042b54 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:10.198667 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2433a3f-7f3d-4f31-bd9e-85ffbd042b54 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:10.199107 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2433a3f-7f3d-4f31-bd9e-85ffbd042b54 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:10.200041 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2433a3f-7f3d-4f31-bd9e-85ffbd042b54 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:10.200474 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2433a3f-7f3d-4f31-bd9e-85ffbd042b54 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:10.346687 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e2433a3f-7f3d-4f31-bd9e-85ffbd042b54 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.160226 Feb 28 19:08:10.347313 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 321/654] 10.222.0.21 () {60 vars in 1315 bytes} [Mon Feb 28 19:08:10 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 19:08:11.944342 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1fc0e498-cd9f-4989-8b7b-83a738640e7f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:11.944835 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1fc0e498-cd9f-4989-8b7b-83a738640e7f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:11.947287 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-2dea6c25-d6d3-48d6-a9ba-dd63aaa645f9 req-2bd3ec9f-f133-45c5-82ce-9ca07770943a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aea8cac-d69e-4467-9c2e-d38652fbf89f", "tag": "29a481fd-7c99-42e1-92d5-26fb61661a7d"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:08:11.948894 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:08:11.948894 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:08:11.952656 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1fc0e498-cd9f-4989-8b7b-83a738640e7f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:11.953112 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1fc0e498-cd9f-4989-8b7b-83a738640e7f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:11.953892 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1fc0e498-cd9f-4989-8b7b-83a738640e7f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:11.954329 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1fc0e498-cd9f-4989-8b7b-83a738640e7f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:11.960536 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-2dea6c25-d6d3-48d6-a9ba-dd63aaa645f9 req-2bd3ec9f-f133-45c5-82ce-9ca07770943a service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:11.961095 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-2dea6c25-d6d3-48d6-a9ba-dd63aaa645f9 req-2bd3ec9f-f133-45c5-82ce-9ca07770943a service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:11.980817 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-2dea6c25-d6d3-48d6-a9ba-dd63aaa645f9 req-2bd3ec9f-f133-45c5-82ce-9ca07770943a service nova] Creating event network-changed:29a481fd-7c99-42e1-92d5-26fb61661a7d for instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f on hv-cinder-83118 Feb 28 19:08:11.986719 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-2dea6c25-d6d3-48d6-a9ba-dd63aaa645f9 req-2bd3ec9f-f133-45c5-82ce-9ca07770943a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043938 Feb 28 19:08:11.987736 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 322/655] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:08:12.020661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1fc0e498-cd9f-4989-8b7b-83a738640e7f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/ips" status: 200 len: 113 microversion: 2.20 time: 0.079912 Feb 28 19:08:12.021878 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 334/656] 10.222.0.21 () {60 vars in 1288 bytes} [Mon Feb 28 19:08:11 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/ips => generated 113 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 28 19:08:18.619772 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:08:18.620507 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: Mon Feb 28 19:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:08:21.625378 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b82d5ea2-b159-45f0-925f-6dab778bd8fa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:21.626370 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b82d5ea2-b159-45f0-925f-6dab778bd8fa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:21.634310 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b82d5ea2-b159-45f0-925f-6dab778bd8fa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:21.634749 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b82d5ea2-b159-45f0-925f-6dab778bd8fa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:21.635544 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b82d5ea2-b159-45f0-925f-6dab778bd8fa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:21.635973 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b82d5ea2-b159-45f0-925f-6dab778bd8fa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:21.698131 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b82d5ea2-b159-45f0-925f-6dab778bd8fa tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076895 Feb 28 19:08:21.698601 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 323/657] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:08:21 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 19:08:21.785647 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-55c675f0-0347-4f22-b295-7a015ec41f4e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:21.786407 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-55c675f0-0347-4f22-b295-7a015ec41f4e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:21.793744 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-55c675f0-0347-4f22-b295-7a015ec41f4e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:21.794191 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-55c675f0-0347-4f22-b295-7a015ec41f4e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:21.794958 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-55c675f0-0347-4f22-b295-7a015ec41f4e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:21.795422 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-55c675f0-0347-4f22-b295-7a015ec41f4e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:21.854795 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-55c675f0-0347-4f22-b295-7a015ec41f4e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Going to try to terminate instance {{(pid=101791) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:08:22.229701 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-55c675f0-0347-4f22-b295-7a015ec41f4e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "DELETE /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 204 len: 0 microversion: 2.1 time: 0.447062 Feb 28 19:08:22.230583 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 335/658] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:08:21 2022] DELETE /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:08:22.238722 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-bda63b6f-b762-4ea9-86d4-e9829d94f8e3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:22.239351 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-bda63b6f-b762-4ea9-86d4-e9829d94f8e3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:22.247366 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bda63b6f-b762-4ea9-86d4-e9829d94f8e3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:22.247810 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bda63b6f-b762-4ea9-86d4-e9829d94f8e3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:22.248565 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bda63b6f-b762-4ea9-86d4-e9829d94f8e3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:22.248991 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bda63b6f-b762-4ea9-86d4-e9829d94f8e3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:22.446028 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-bda63b6f-b762-4ea9-86d4-e9829d94f8e3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:22.454075 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-bda63b6f-b762-4ea9-86d4-e9829d94f8e3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1672 microversion: 2.1 time: 0.219136 Feb 28 19:08:22.454631 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 324/659] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:22 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:08:23.471714 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ebfdbad5-b0a3-410b-9b94-19354d31c6d3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:23.472420 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ebfdbad5-b0a3-410b-9b94-19354d31c6d3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:23.480053 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebfdbad5-b0a3-410b-9b94-19354d31c6d3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:23.480505 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebfdbad5-b0a3-410b-9b94-19354d31c6d3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:23.481271 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebfdbad5-b0a3-410b-9b94-19354d31c6d3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:23.481706 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebfdbad5-b0a3-410b-9b94-19354d31c6d3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:23.677724 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ebfdbad5-b0a3-410b-9b94-19354d31c6d3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:23.686577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ebfdbad5-b0a3-410b-9b94-19354d31c6d3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1672 microversion: 2.1 time: 0.218961 Feb 28 19:08:23.687169 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 336/660] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:23 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:24.704023 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6e688484-1f70-4343-8554-bd94587c0774 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:24.705312 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6e688484-1f70-4343-8554-bd94587c0774 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:24.715177 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6e688484-1f70-4343-8554-bd94587c0774 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:24.715177 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6e688484-1f70-4343-8554-bd94587c0774 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:24.715177 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6e688484-1f70-4343-8554-bd94587c0774 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:24.715177 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6e688484-1f70-4343-8554-bd94587c0774 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:24.832714 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6e688484-1f70-4343-8554-bd94587c0774 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:24.841805 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6e688484-1f70-4343-8554-bd94587c0774 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1604 microversion: 2.1 time: 0.141535 Feb 28 19:08:24.842395 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 325/661] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:24 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1604 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:25.170560 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-4a3a271e-3c66-479d-8041-1cd9d128320d req-a48714fa-0b3d-45a4-b1c0-327baab27805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45883a52-0422-4de3-b428-d6f24780b283", "name": "network-vif-deleted", "tag": "f30d713e-926a-4637-924b-eabbced9f31c"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:08:25.172879 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:08:25.172879 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:08:25.181160 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-4a3a271e-3c66-479d-8041-1cd9d128320d req-a48714fa-0b3d-45a4-b1c0-327baab27805 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:25.182825 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-4a3a271e-3c66-479d-8041-1cd9d128320d req-a48714fa-0b3d-45a4-b1c0-327baab27805 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:25.204176 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-4a3a271e-3c66-479d-8041-1cd9d128320d req-a48714fa-0b3d-45a4-b1c0-327baab27805 service nova] Creating event network-vif-deleted:f30d713e-926a-4637-924b-eabbced9f31c for instance 45883a52-0422-4de3-b428-d6f24780b283 on hv-cinder-83118 Feb 28 19:08:25.209489 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-4a3a271e-3c66-479d-8041-1cd9d128320d req-a48714fa-0b3d-45a4-b1c0-327baab27805 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042830 Feb 28 19:08:25.210082 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 337/662] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:08:25.858424 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-27d63f36-03ca-486f-bbc8-e5c9391affa8 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:25.859030 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-27d63f36-03ca-486f-bbc8-e5c9391affa8 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:25.866266 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-27d63f36-03ca-486f-bbc8-e5c9391affa8 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:25.866710 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-27d63f36-03ca-486f-bbc8-e5c9391affa8 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:25.870325 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-27d63f36-03ca-486f-bbc8-e5c9391affa8 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:25.870816 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-27d63f36-03ca-486f-bbc8-e5c9391affa8 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:25.941301 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-27d63f36-03ca-486f-bbc8-e5c9391affa8 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:25.941747 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-27d63f36-03ca-486f-bbc8-e5c9391affa8 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:25.942201 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-27d63f36-03ca-486f-bbc8-e5c9391affa8 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lazy-loading 'fault' on Instance uuid 45883a52-0422-4de3-b428-d6f24780b283 {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:08:25.999830 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-27d63f36-03ca-486f-bbc8-e5c9391affa8 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:26.008246 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-27d63f36-03ca-486f-bbc8-e5c9391affa8 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 200 len: 1326 microversion: 2.1 time: 0.153310 Feb 28 19:08:26.008945 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 326/663] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:25 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:27.026897 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b1819d3f-deb6-471a-a6e2-d06439d1401b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:27.027789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b1819d3f-deb6-471a-a6e2-d06439d1401b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:27.036383 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1819d3f-deb6-471a-a6e2-d06439d1401b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:27.036831 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1819d3f-deb6-471a-a6e2-d06439d1401b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:27.037608 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1819d3f-deb6-471a-a6e2-d06439d1401b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:27.038041 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1819d3f-deb6-471a-a6e2-d06439d1401b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:27.086729 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-b1819d3f-deb6-471a-a6e2-d06439d1401b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] HTTP exception thrown: Instance 45883a52-0422-4de3-b428-d6f24780b283 could not be found. Feb 28 19:08:27.087356 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b1819d3f-deb6-471a-a6e2-d06439d1401b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Returning 404 to user: Instance 45883a52-0422-4de3-b428-d6f24780b283 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:08:27.088204 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b1819d3f-deb6-471a-a6e2-d06439d1401b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 404 len: 111 microversion: 2.1 time: 0.066497 Feb 28 19:08:27.088748 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 338/664] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:27 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:08:27.096876 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-eed25fdf-ecd1-4d32-867c-f2f2f638de67 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '.version_select at 0x7f912e189280>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:27.172361 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-eed25fdf-ecd1-4d32-867c-f2f2f638de67 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163681716" status: 202 len: 0 microversion: 2.1 time: 0.079014 Feb 28 19:08:27.172933 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 327/665] 10.222.0.21 () {58 vars in 1217 bytes} [Mon Feb 28 19:08:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163681716 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:08:28.454728 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-19ccfe7a-5706-425c-906f-07c551423ee1 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Action: 'create', calling method: .version_select at 0x7f912e66a3a0>, body: {"keypair": {"name": "tempest-keypair-237206392"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:08:28.476595 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-19ccfe7a-5706-425c-906f-07c551423ee1 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:08:28.480428 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-19ccfe7a-5706-425c-906f-07c551423ee1 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for user d7a958a47ae44558a637dbe34b5a8f9b and project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:08:28.687948 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-19ccfe7a-5706-425c-906f-07c551423ee1 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:08:28.691703 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-19ccfe7a-5706-425c-906f-07c551423ee1 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for user d7a958a47ae44558a637dbe34b5a8f9b and project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:08:28.704737 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-19ccfe7a-5706-425c-906f-07c551423ee1 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.253697 Feb 28 19:08:28.705318 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 339/666] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Feb 28 19:08:28 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:31.268952 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-429055892", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c812996-20a8-48cd-b6ed-d12028f6c0ff"}], "security_groups": [{"name": "tempest-securitygroup--180398977"}], "key_name": "tempest-keypair-237206392", "user_data": "}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:08:31.481065 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] validate_networks() for [('1c812996-20a8-48cd-b6ed-d12028f6c0ff', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:08:32.093862 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:08:32.094309 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:08:32.094786 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:08:32.095255 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:08:32.095669 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:08:32.103946 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:32.104390 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:32.105183 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:32.105616 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:32.122580 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:08:32.126447 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Getting quotas for user d7a958a47ae44558a637dbe34b5a8f9b and project e00c264516ff48bdb7d2411e37b27ff4. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:08:32.137530 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:08:32.139867 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:08:32.269265 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e81ec8df-d452-43a4-ba71-ac0da597fbd5 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.004397 Feb 28 19:08:32.269983 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 328/667] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:08:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:08:32.280566 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c98e0833-3234-4fc0-ad3e-cd47b8aa3047 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:32.281312 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c98e0833-3234-4fc0-ad3e-cd47b8aa3047 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:32.352321 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c98e0833-3234-4fc0-ad3e-cd47b8aa3047 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:32.359684 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c98e0833-3234-4fc0-ad3e-cd47b8aa3047 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1236 microversion: 2.1 time: 0.082785 Feb 28 19:08:32.360248 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 340/668] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:32 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:33.376881 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-83a47ac4-6cfb-4018-bf11-f76d04952074 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:33.377477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-83a47ac4-6cfb-4018-bf11-f76d04952074 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:33.384998 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-83a47ac4-6cfb-4018-bf11-f76d04952074 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:33.385436 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-83a47ac4-6cfb-4018-bf11-f76d04952074 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:33.386195 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-83a47ac4-6cfb-4018-bf11-f76d04952074 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:33.386622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-83a47ac4-6cfb-4018-bf11-f76d04952074 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:33.500429 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-83a47ac4-6cfb-4018-bf11-f76d04952074 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:33.508891 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-83a47ac4-6cfb-4018-bf11-f76d04952074 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1240 microversion: 2.1 time: 0.135701 Feb 28 19:08:33.509445 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 329/669] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:33 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:34.525541 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4702aeaf-4700-49b8-bb2b-d48581764d81 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:34.526211 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4702aeaf-4700-49b8-bb2b-d48581764d81 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:34.533453 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4702aeaf-4700-49b8-bb2b-d48581764d81 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:34.533923 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4702aeaf-4700-49b8-bb2b-d48581764d81 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:34.534683 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4702aeaf-4700-49b8-bb2b-d48581764d81 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:34.535147 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4702aeaf-4700-49b8-bb2b-d48581764d81 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:34.670349 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4702aeaf-4700-49b8-bb2b-d48581764d81 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:34.679083 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4702aeaf-4700-49b8-bb2b-d48581764d81 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1288 microversion: 2.1 time: 0.158171 Feb 28 19:08:34.679702 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 341/670] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:34 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1288 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:35.696285 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1f1eb40c-4992-498c-b978-f0cd50bd726c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:35.696839 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1f1eb40c-4992-498c-b978-f0cd50bd726c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:35.704961 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1f1eb40c-4992-498c-b978-f0cd50bd726c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:35.705435 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1f1eb40c-4992-498c-b978-f0cd50bd726c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:35.706100 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1f1eb40c-4992-498c-b978-f0cd50bd726c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:35.706527 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1f1eb40c-4992-498c-b978-f0cd50bd726c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:35.909644 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1f1eb40c-4992-498c-b978-f0cd50bd726c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:35.918731 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1f1eb40c-4992-498c-b978-f0cd50bd726c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1361 microversion: 2.1 time: 0.226145 Feb 28 19:08:35.919505 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 330/671] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:35 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:36.940928 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-43dfad17-fd07-4947-ac87-733732455e21 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:36.942881 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-43dfad17-fd07-4947-ac87-733732455e21 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:36.955139 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-43dfad17-fd07-4947-ac87-733732455e21 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:36.955627 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-43dfad17-fd07-4947-ac87-733732455e21 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:36.956426 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-43dfad17-fd07-4947-ac87-733732455e21 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:36.957338 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-43dfad17-fd07-4947-ac87-733732455e21 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:37.104594 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-2dcc5606-eb20-4f7b-a36f-813bd3780f82 req-dd8cc3b4-6c08-46b3-838a-c4b1f2ba941d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970b2934-fe16-4039-9044-1e31b3217360", "tag": "4c635eef-3e33-4a57-89ab-34702645a636"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:08:37.106160 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:08:37.106160 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:08:37.114653 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-2dcc5606-eb20-4f7b-a36f-813bd3780f82 req-dd8cc3b4-6c08-46b3-838a-c4b1f2ba941d service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:37.115100 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-2dcc5606-eb20-4f7b-a36f-813bd3780f82 req-dd8cc3b4-6c08-46b3-838a-c4b1f2ba941d service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:37.139269 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-2dcc5606-eb20-4f7b-a36f-813bd3780f82 req-dd8cc3b4-6c08-46b3-838a-c4b1f2ba941d service nova] Creating event network-changed:4c635eef-3e33-4a57-89ab-34702645a636 for instance 970b2934-fe16-4039-9044-1e31b3217360 on hv-cinder-83118 Feb 28 19:08:37.146277 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-2dcc5606-eb20-4f7b-a36f-813bd3780f82 req-dd8cc3b4-6c08-46b3-838a-c4b1f2ba941d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045356 Feb 28 19:08:37.147469 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 331/672] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:08:37.168761 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-43dfad17-fd07-4947-ac87-733732455e21 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:37.177230 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-43dfad17-fd07-4947-ac87-733732455e21 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1361 microversion: 2.1 time: 0.243486 Feb 28 19:08:37.178028 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 342/673] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:36 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:38.195309 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-be3fa292-2e13-4f50-bcce-8c2565425b02 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:38.196055 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-be3fa292-2e13-4f50-bcce-8c2565425b02 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:38.203534 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-be3fa292-2e13-4f50-bcce-8c2565425b02 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:38.203985 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-be3fa292-2e13-4f50-bcce-8c2565425b02 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:38.204750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-be3fa292-2e13-4f50-bcce-8c2565425b02 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:38.205181 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-be3fa292-2e13-4f50-bcce-8c2565425b02 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:38.408132 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-be3fa292-2e13-4f50-bcce-8c2565425b02 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:38.416432 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-be3fa292-2e13-4f50-bcce-8c2565425b02 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1361 microversion: 2.1 time: 0.225278 Feb 28 19:08:38.416988 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 332/674] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:38 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:39.432894 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-dfdf9e39-008f-4684-8ab8-6aa4374e2bc3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:39.433425 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-dfdf9e39-008f-4684-8ab8-6aa4374e2bc3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:39.440653 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dfdf9e39-008f-4684-8ab8-6aa4374e2bc3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:39.441096 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dfdf9e39-008f-4684-8ab8-6aa4374e2bc3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:39.441858 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dfdf9e39-008f-4684-8ab8-6aa4374e2bc3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:39.442290 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dfdf9e39-008f-4684-8ab8-6aa4374e2bc3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:39.635176 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-dfdf9e39-008f-4684-8ab8-6aa4374e2bc3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:39.643132 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-dfdf9e39-008f-4684-8ab8-6aa4374e2bc3 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1361 microversion: 2.1 time: 0.214105 Feb 28 19:08:39.643693 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 343/675] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:39 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:40.660178 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-df550805-f195-41a7-b281-eaa21e22f98e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:40.661245 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-df550805-f195-41a7-b281-eaa21e22f98e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:40.669200 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df550805-f195-41a7-b281-eaa21e22f98e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:40.669635 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df550805-f195-41a7-b281-eaa21e22f98e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:40.670387 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df550805-f195-41a7-b281-eaa21e22f98e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:40.670809 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-df550805-f195-41a7-b281-eaa21e22f98e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:40.864217 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-df550805-f195-41a7-b281-eaa21e22f98e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:40.872326 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-df550805-f195-41a7-b281-eaa21e22f98e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1361 microversion: 2.1 time: 0.215819 Feb 28 19:08:40.872881 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 333/676] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:40 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:41.889274 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5acfcd95-9cc7-4fec-9f98-d546b162c4f4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:41.889805 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5acfcd95-9cc7-4fec-9f98-d546b162c4f4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:41.896966 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5acfcd95-9cc7-4fec-9f98-d546b162c4f4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:41.897412 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5acfcd95-9cc7-4fec-9f98-d546b162c4f4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:41.898188 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5acfcd95-9cc7-4fec-9f98-d546b162c4f4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:41.898619 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5acfcd95-9cc7-4fec-9f98-d546b162c4f4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:42.185559 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5acfcd95-9cc7-4fec-9f98-d546b162c4f4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:42.193614 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5acfcd95-9cc7-4fec-9f98-d546b162c4f4 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1361 microversion: 2.1 time: 0.308481 Feb 28 19:08:42.194171 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 344/677] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:41 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:43.210529 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-165ed5f3-d0fd-440d-8285-5f3c44793dfb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:43.211176 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-165ed5f3-d0fd-440d-8285-5f3c44793dfb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:43.218448 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-165ed5f3-d0fd-440d-8285-5f3c44793dfb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:43.218885 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-165ed5f3-d0fd-440d-8285-5f3c44793dfb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:43.219681 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-165ed5f3-d0fd-440d-8285-5f3c44793dfb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:43.220110 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-165ed5f3-d0fd-440d-8285-5f3c44793dfb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:43.396146 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-1bfa8231-f671-4f5a-b829-b3b42106afb6 req-92a0f7bf-6f61-4081-bcd1-299116406d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970b2934-fe16-4039-9044-1e31b3217360", "name": "network-vif-plugged", "status": "completed", "tag": "4c635eef-3e33-4a57-89ab-34702645a636"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:08:43.397932 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:08:43.397932 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:08:43.406226 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-1bfa8231-f671-4f5a-b829-b3b42106afb6 req-92a0f7bf-6f61-4081-bcd1-299116406d2b service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:43.406668 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-1bfa8231-f671-4f5a-b829-b3b42106afb6 req-92a0f7bf-6f61-4081-bcd1-299116406d2b service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:43.416451 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-165ed5f3-d0fd-440d-8285-5f3c44793dfb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:43.423261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-1bfa8231-f671-4f5a-b829-b3b42106afb6 req-92a0f7bf-6f61-4081-bcd1-299116406d2b service nova] Creating event network-vif-plugged:4c635eef-3e33-4a57-89ab-34702645a636 for instance 970b2934-fe16-4039-9044-1e31b3217360 on hv-cinder-83118 Feb 28 19:08:43.425231 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-165ed5f3-d0fd-440d-8285-5f3c44793dfb tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1361 microversion: 2.1 time: 0.218621 Feb 28 19:08:43.425824 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 334/678] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:43 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:43.428244 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-1bfa8231-f671-4f5a-b829-b3b42106afb6 req-92a0f7bf-6f61-4081-bcd1-299116406d2b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035677 Feb 28 19:08:43.428812 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 345/679] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:08:44.441970 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a00871d4-d519-4e9c-b685-685613554b5e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:44.442601 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a00871d4-d519-4e9c-b685-685613554b5e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:44.450614 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a00871d4-d519-4e9c-b685-685613554b5e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:44.451056 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a00871d4-d519-4e9c-b685-685613554b5e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:44.451834 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a00871d4-d519-4e9c-b685-685613554b5e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:44.452260 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a00871d4-d519-4e9c-b685-685613554b5e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:44.652863 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a00871d4-d519-4e9c-b685-685613554b5e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:44.661023 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a00871d4-d519-4e9c-b685-685613554b5e tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1361 microversion: 2.1 time: 0.222683 Feb 28 19:08:44.661578 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 335/680] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:44 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:45.677807 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-15745803-bc20-4889-bf8c-e9954c0317ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:45.678526 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-15745803-bc20-4889-bf8c-e9954c0317ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:45.686469 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-15745803-bc20-4889-bf8c-e9954c0317ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:45.686910 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-15745803-bc20-4889-bf8c-e9954c0317ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:45.687703 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-15745803-bc20-4889-bf8c-e9954c0317ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:45.688130 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-15745803-bc20-4889-bf8c-e9954c0317ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:45.883344 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-15745803-bc20-4889-bf8c-e9954c0317ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:08:45.892091 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-15745803-bc20-4889-bf8c-e9954c0317ad tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1547 microversion: 2.1 time: 0.218424 Feb 28 19:08:45.892641 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 346/681] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:08:45 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1547 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:08:45.907887 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-78ba698b-c3d7-4951-9e1a-81caf22575db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:45.908386 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-78ba698b-c3d7-4951-9e1a-81caf22575db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:45.915696 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-78ba698b-c3d7-4951-9e1a-81caf22575db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:45.916311 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-78ba698b-c3d7-4951-9e1a-81caf22575db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:45.917080 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-78ba698b-c3d7-4951-9e1a-81caf22575db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:45.917589 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-78ba698b-c3d7-4951-9e1a-81caf22575db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:46.061570 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-78ba698b-c3d7-4951-9e1a-81caf22575db tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157300 Feb 28 19:08:46.062157 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 336/682] 10.222.0.21 () {58 vars in 1274 bytes} [Mon Feb 28 19:08:45 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:08:47.641087 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8ef7eea3-d4fe-433d-b1ed-6594519c1054 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:47.641608 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8ef7eea3-d4fe-433d-b1ed-6594519c1054 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:47.643338 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-34cee41f-8952-4bee-b72c-1fa2b1422d29 req-5ee8ec2e-a7ed-4d6a-a376-19e910a3f6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970b2934-fe16-4039-9044-1e31b3217360", "tag": "4c635eef-3e33-4a57-89ab-34702645a636"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:08:47.645053 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:08:47.645053 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:08:47.649073 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ef7eea3-d4fe-433d-b1ed-6594519c1054 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:47.649455 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ef7eea3-d4fe-433d-b1ed-6594519c1054 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:47.650437 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ef7eea3-d4fe-433d-b1ed-6594519c1054 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:47.650877 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ef7eea3-d4fe-433d-b1ed-6594519c1054 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:47.654577 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-34cee41f-8952-4bee-b72c-1fa2b1422d29 req-5ee8ec2e-a7ed-4d6a-a376-19e910a3f6c5 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:47.655081 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-34cee41f-8952-4bee-b72c-1fa2b1422d29 req-5ee8ec2e-a7ed-4d6a-a376-19e910a3f6c5 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:47.671384 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-34cee41f-8952-4bee-b72c-1fa2b1422d29 req-5ee8ec2e-a7ed-4d6a-a376-19e910a3f6c5 service nova] Creating event network-changed:4c635eef-3e33-4a57-89ab-34702645a636 for instance 970b2934-fe16-4039-9044-1e31b3217360 on hv-cinder-83118 Feb 28 19:08:47.677768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-34cee41f-8952-4bee-b72c-1fa2b1422d29 req-5ee8ec2e-a7ed-4d6a-a376-19e910a3f6c5 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037413 Feb 28 19:08:47.677938 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 337/683] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:08:47.710684 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8ef7eea3-d4fe-433d-b1ed-6594519c1054 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/ips" status: 200 len: 106 microversion: 2.1 time: 0.073524 Feb 28 19:08:47.712405 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 347/684] 10.222.0.21 () {58 vars in 1247 bytes} [Mon Feb 28 19:08:47 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/ips => generated 106 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:08:49.648557 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0ab42fd5-8bb3-479a-93ec-181b59829562 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bf34700-e366-4c39-bae2-08b40cca9a18"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:08:49.649726 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0ab42fd5-8bb3-479a-93ec-181b59829562 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:49.657356 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0ab42fd5-8bb3-479a-93ec-181b59829562 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:49.657805 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0ab42fd5-8bb3-479a-93ec-181b59829562 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:49.658569 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0ab42fd5-8bb3-479a-93ec-181b59829562 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:49.659007 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0ab42fd5-8bb3-479a-93ec-181b59829562 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:50.625245 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0ab42fd5-8bb3-479a-93ec-181b59829562 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "POST /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980696 Feb 28 19:08:50.625895 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 338/685] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:08:49 2022] POST /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments => generated 194 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:08:58.378055 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9548cc60-a122-41da-a65e-6c2a090d0896 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:58.378961 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9548cc60-a122-41da-a65e-6c2a090d0896 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:58.386404 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9548cc60-a122-41da-a65e-6c2a090d0896 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:58.387538 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9548cc60-a122-41da-a65e-6c2a090d0896 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:58.388298 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9548cc60-a122-41da-a65e-6c2a090d0896 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:58.388729 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9548cc60-a122-41da-a65e-6c2a090d0896 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:58.454815 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9548cc60-a122-41da-a65e-6c2a090d0896 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080493 Feb 28 19:08:58.455401 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 348/686] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:08:58 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:08:58.466272 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-18ace259-f9c6-49db-afe9-2bd0c3530770 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:08:58.466774 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-18ace259-f9c6-49db-afe9-2bd0c3530770 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:08:58.474844 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18ace259-f9c6-49db-afe9-2bd0c3530770 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:58.475328 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18ace259-f9c6-49db-afe9-2bd0c3530770 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:58.476096 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18ace259-f9c6-49db-afe9-2bd0c3530770 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:08:58.476530 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18ace259-f9c6-49db-afe9-2bd0c3530770 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:08:58.540747 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-18ace259-f9c6-49db-afe9-2bd0c3530770 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments/7bf34700-e366-4c39-bae2-08b40cca9a18" status: 200 len: 194 microversion: 2.1 time: 0.079260 Feb 28 19:08:58.541319 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 339/687] 10.222.0.21 () {58 vars in 1412 bytes} [Mon Feb 28 19:08:58 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments/7bf34700-e366-4c39-bae2-08b40cca9a18 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:09:00.317459 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b959e14b-a0c8-42f4-9e20-dac32a462157 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0974d49-bba1-4027-ae93-80ea291b2a23"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:09:00.318505 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b959e14b-a0c8-42f4-9e20-dac32a462157 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:00.326385 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b959e14b-a0c8-42f4-9e20-dac32a462157 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:00.326818 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b959e14b-a0c8-42f4-9e20-dac32a462157 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:00.327609 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b959e14b-a0c8-42f4-9e20-dac32a462157 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:00.328033 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b959e14b-a0c8-42f4-9e20-dac32a462157 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:01.347752 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b959e14b-a0c8-42f4-9e20-dac32a462157 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "POST /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.033695 Feb 28 19:09:01.348393 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 349/688] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:09:00 2022] POST /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments => generated 194 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:09:10.182262 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d8ea64d6-e331-4f7e-a7b1-80c70593b3e9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:10.183926 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d8ea64d6-e331-4f7e-a7b1-80c70593b3e9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:10.191484 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d8ea64d6-e331-4f7e-a7b1-80c70593b3e9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:10.191950 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d8ea64d6-e331-4f7e-a7b1-80c70593b3e9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:10.192701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d8ea64d6-e331-4f7e-a7b1-80c70593b3e9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:10.193135 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d8ea64d6-e331-4f7e-a7b1-80c70593b3e9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:10.256974 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d8ea64d6-e331-4f7e-a7b1-80c70593b3e9 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.078401 Feb 28 19:09:10.257456 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 340/689] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:09:10 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:09:28.350280 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-794c74b7-8ab5-430b-8511-988ece7671fd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:09:28.350867 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-794c74b7-8ab5-430b-8511-988ece7671fd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:28.359889 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-794c74b7-8ab5-430b-8511-988ece7671fd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:28.360341 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-794c74b7-8ab5-430b-8511-988ece7671fd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:28.361112 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-794c74b7-8ab5-430b-8511-988ece7671fd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:28.361602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-794c74b7-8ab5-430b-8511-988ece7671fd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:28.418189 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-794c74b7-8ab5-430b-8511-988ece7671fd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lazy-loading 'flavor' on Instance uuid 1aea8cac-d69e-4467-9c2e-d38652fbf89f {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:09:29.234344 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-794c74b7-8ab5-430b-8511-988ece7671fd tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "POST /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/action" status: 202 len: 0 microversion: 2.20 time: 0.888153 Feb 28 19:09:29.235866 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 350/690] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Feb 28 19:09:28 2022] POST /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/action => generated 0 bytes in 890 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:09:29.243292 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-85ab6a49-698a-464f-83ea-95ba805e0af6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:29.243940 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-85ab6a49-698a-464f-83ea-95ba805e0af6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:29.251946 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-85ab6a49-698a-464f-83ea-95ba805e0af6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:29.252393 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-85ab6a49-698a-464f-83ea-95ba805e0af6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:29.253165 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-85ab6a49-698a-464f-83ea-95ba805e0af6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:29.253598 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-85ab6a49-698a-464f-83ea-95ba805e0af6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:29.455539 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-85ab6a49-698a-464f-83ea-95ba805e0af6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:29.464079 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-85ab6a49-698a-464f-83ea-95ba805e0af6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:29.466242 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-85ab6a49-698a-464f-83ea-95ba805e0af6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:29.467546 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-85ab6a49-698a-464f-83ea-95ba805e0af6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.228084 Feb 28 19:09:29.469500 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 341/691] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:29 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:30.487240 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-abdd790c-5a1e-446f-9a1d-6c254e4fadc7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:30.487930 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-abdd790c-5a1e-446f-9a1d-6c254e4fadc7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:30.495445 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-abdd790c-5a1e-446f-9a1d-6c254e4fadc7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:30.495889 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-abdd790c-5a1e-446f-9a1d-6c254e4fadc7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:30.496861 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-abdd790c-5a1e-446f-9a1d-6c254e4fadc7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:30.497396 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-abdd790c-5a1e-446f-9a1d-6c254e4fadc7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:30.694527 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-abdd790c-5a1e-446f-9a1d-6c254e4fadc7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:30.703541 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-abdd790c-5a1e-446f-9a1d-6c254e4fadc7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:30.705012 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-abdd790c-5a1e-446f-9a1d-6c254e4fadc7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:30.706118 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-abdd790c-5a1e-446f-9a1d-6c254e4fadc7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.223600 Feb 28 19:09:30.706681 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 351/692] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:30 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:31.724845 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cb4686fc-a52c-4309-b04a-afca06259420 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:31.725458 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-cb4686fc-a52c-4309-b04a-afca06259420 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:31.733326 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cb4686fc-a52c-4309-b04a-afca06259420 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:31.733775 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cb4686fc-a52c-4309-b04a-afca06259420 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:31.734542 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cb4686fc-a52c-4309-b04a-afca06259420 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:31.734977 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cb4686fc-a52c-4309-b04a-afca06259420 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:31.936620 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cb4686fc-a52c-4309-b04a-afca06259420 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:31.945244 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cb4686fc-a52c-4309-b04a-afca06259420 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:31.946713 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-cb4686fc-a52c-4309-b04a-afca06259420 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:31.947907 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-cb4686fc-a52c-4309-b04a-afca06259420 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.226837 Feb 28 19:09:31.949165 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 342/693] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:31 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:32.965663 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f0dc0e77-5dbc-48a8-83fe-c18918260882 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:32.966477 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f0dc0e77-5dbc-48a8-83fe-c18918260882 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:32.974723 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f0dc0e77-5dbc-48a8-83fe-c18918260882 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:32.975299 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f0dc0e77-5dbc-48a8-83fe-c18918260882 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:32.976189 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f0dc0e77-5dbc-48a8-83fe-c18918260882 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:32.976704 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f0dc0e77-5dbc-48a8-83fe-c18918260882 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:33.174168 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f0dc0e77-5dbc-48a8-83fe-c18918260882 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:33.182980 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f0dc0e77-5dbc-48a8-83fe-c18918260882 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:33.184493 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f0dc0e77-5dbc-48a8-83fe-c18918260882 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:33.185719 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f0dc0e77-5dbc-48a8-83fe-c18918260882 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.223756 Feb 28 19:09:33.186409 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 352/694] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:32 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:34.205018 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-327441d6-b36f-4099-9197-9e028eba8159 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:34.205609 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-327441d6-b36f-4099-9197-9e028eba8159 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:34.213076 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-327441d6-b36f-4099-9197-9e028eba8159 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:34.213542 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-327441d6-b36f-4099-9197-9e028eba8159 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:34.214337 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-327441d6-b36f-4099-9197-9e028eba8159 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:34.214764 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-327441d6-b36f-4099-9197-9e028eba8159 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:34.407421 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-327441d6-b36f-4099-9197-9e028eba8159 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:34.416200 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-327441d6-b36f-4099-9197-9e028eba8159 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:34.417689 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-327441d6-b36f-4099-9197-9e028eba8159 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:34.418807 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-327441d6-b36f-4099-9197-9e028eba8159 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.217624 Feb 28 19:09:34.419403 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 343/695] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:34 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:35.437448 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-700f186d-0007-4571-94fb-e7998b8aeb9e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:35.438050 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-700f186d-0007-4571-94fb-e7998b8aeb9e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:35.445221 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-700f186d-0007-4571-94fb-e7998b8aeb9e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:35.445666 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-700f186d-0007-4571-94fb-e7998b8aeb9e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:35.446576 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-700f186d-0007-4571-94fb-e7998b8aeb9e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:35.447006 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-700f186d-0007-4571-94fb-e7998b8aeb9e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:35.644867 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-700f186d-0007-4571-94fb-e7998b8aeb9e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:35.653356 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-700f186d-0007-4571-94fb-e7998b8aeb9e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:35.654926 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-700f186d-0007-4571-94fb-e7998b8aeb9e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:35.656070 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-700f186d-0007-4571-94fb-e7998b8aeb9e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.222865 Feb 28 19:09:35.656618 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 353/696] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:35 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:36.674355 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-676ec0ff-5746-447a-b81a-781eab1b4512 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:36.675015 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-676ec0ff-5746-447a-b81a-781eab1b4512 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:36.682325 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-676ec0ff-5746-447a-b81a-781eab1b4512 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:36.682785 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-676ec0ff-5746-447a-b81a-781eab1b4512 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:36.683679 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-676ec0ff-5746-447a-b81a-781eab1b4512 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:36.684123 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-676ec0ff-5746-447a-b81a-781eab1b4512 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:36.874569 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-676ec0ff-5746-447a-b81a-781eab1b4512 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:36.883427 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-676ec0ff-5746-447a-b81a-781eab1b4512 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:36.884918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-676ec0ff-5746-447a-b81a-781eab1b4512 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:36.886040 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-676ec0ff-5746-447a-b81a-781eab1b4512 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.215521 Feb 28 19:09:36.886588 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 344/697] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:36 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:37.905662 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-348e5bea-df3d-4394-b30c-141cf46cc975 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:37.906288 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-348e5bea-df3d-4394-b30c-141cf46cc975 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:37.913851 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-348e5bea-df3d-4394-b30c-141cf46cc975 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:37.914325 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-348e5bea-df3d-4394-b30c-141cf46cc975 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:37.915126 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-348e5bea-df3d-4394-b30c-141cf46cc975 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:37.915571 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-348e5bea-df3d-4394-b30c-141cf46cc975 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:38.118096 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-348e5bea-df3d-4394-b30c-141cf46cc975 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:38.126909 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-348e5bea-df3d-4394-b30c-141cf46cc975 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:38.128436 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-348e5bea-df3d-4394-b30c-141cf46cc975 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:38.129553 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-348e5bea-df3d-4394-b30c-141cf46cc975 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.228802 Feb 28 19:09:38.130162 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 354/698] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:37 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:39.148531 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a2e5e02f-8213-4e79-89bd-9e14c7c3f82c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:39.149136 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a2e5e02f-8213-4e79-89bd-9e14c7c3f82c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:39.156576 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2e5e02f-8213-4e79-89bd-9e14c7c3f82c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:39.157017 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2e5e02f-8213-4e79-89bd-9e14c7c3f82c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:39.157773 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2e5e02f-8213-4e79-89bd-9e14c7c3f82c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:39.158203 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2e5e02f-8213-4e79-89bd-9e14c7c3f82c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:39.359275 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a2e5e02f-8213-4e79-89bd-9e14c7c3f82c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:39.367667 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a2e5e02f-8213-4e79-89bd-9e14c7c3f82c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:39.369178 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a2e5e02f-8213-4e79-89bd-9e14c7c3f82c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:39.370282 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a2e5e02f-8213-4e79-89bd-9e14c7c3f82c tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.225498 Feb 28 19:09:39.370835 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 345/699] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:39 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:40.388933 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-99620812-3cdf-4fe1-a814-16f24a658509 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:40.389572 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-99620812-3cdf-4fe1-a814-16f24a658509 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:40.397094 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-99620812-3cdf-4fe1-a814-16f24a658509 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:40.397533 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-99620812-3cdf-4fe1-a814-16f24a658509 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:40.398297 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-99620812-3cdf-4fe1-a814-16f24a658509 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:40.398728 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-99620812-3cdf-4fe1-a814-16f24a658509 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:40.591676 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-99620812-3cdf-4fe1-a814-16f24a658509 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:40.601441 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-99620812-3cdf-4fe1-a814-16f24a658509 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:40.602957 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-99620812-3cdf-4fe1-a814-16f24a658509 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:40.604102 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-99620812-3cdf-4fe1-a814-16f24a658509 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.219110 Feb 28 19:09:40.604700 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 355/700] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:40 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:41.621548 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d593152e-0d05-41f1-9e03-d7341cee0001 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:41.622151 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d593152e-0d05-41f1-9e03-d7341cee0001 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:41.630140 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d593152e-0d05-41f1-9e03-d7341cee0001 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:41.630579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d593152e-0d05-41f1-9e03-d7341cee0001 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:41.631367 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d593152e-0d05-41f1-9e03-d7341cee0001 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:41.631793 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d593152e-0d05-41f1-9e03-d7341cee0001 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:41.912268 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d593152e-0d05-41f1-9e03-d7341cee0001 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:41.921274 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d593152e-0d05-41f1-9e03-d7341cee0001 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:41.923460 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d593152e-0d05-41f1-9e03-d7341cee0001 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:41.924568 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d593152e-0d05-41f1-9e03-d7341cee0001 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1746 microversion: 2.20 time: 0.306679 Feb 28 19:09:41.925116 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 346/701] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:41 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1746 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:42.943510 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-21f04619-9a38-4c6a-9582-f41f7055e4c3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:42.944119 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-21f04619-9a38-4c6a-9582-f41f7055e4c3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:42.951354 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-21f04619-9a38-4c6a-9582-f41f7055e4c3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:42.951806 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-21f04619-9a38-4c6a-9582-f41f7055e4c3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:42.952576 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-21f04619-9a38-4c6a-9582-f41f7055e4c3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:42.953007 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-21f04619-9a38-4c6a-9582-f41f7055e4c3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:43.148635 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-21f04619-9a38-4c6a-9582-f41f7055e4c3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:43.157244 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-21f04619-9a38-4c6a-9582-f41f7055e4c3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:43.159001 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-21f04619-9a38-4c6a-9582-f41f7055e4c3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:43.160148 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-21f04619-9a38-4c6a-9582-f41f7055e4c3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1746 microversion: 2.20 time: 0.220395 Feb 28 19:09:43.160709 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 356/702] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:42 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1746 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:44.178331 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0d948f5d-b9a5-44f5-bd00-7c1fc775cc9a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:44.178934 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0d948f5d-b9a5-44f5-bd00-7c1fc775cc9a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:44.186713 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0d948f5d-b9a5-44f5-bd00-7c1fc775cc9a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:44.187181 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0d948f5d-b9a5-44f5-bd00-7c1fc775cc9a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:44.187944 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0d948f5d-b9a5-44f5-bd00-7c1fc775cc9a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:44.188524 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0d948f5d-b9a5-44f5-bd00-7c1fc775cc9a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:44.385063 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0d948f5d-b9a5-44f5-bd00-7c1fc775cc9a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:44.394891 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0d948f5d-b9a5-44f5-bd00-7c1fc775cc9a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:44.396441 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0d948f5d-b9a5-44f5-bd00-7c1fc775cc9a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:44.397552 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0d948f5d-b9a5-44f5-bd00-7c1fc775cc9a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1746 microversion: 2.20 time: 0.223072 Feb 28 19:09:44.398116 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 347/703] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:44 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1746 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:45.418597 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-bdeb0a18-9ccb-4e3e-9d41-0100a6da3235 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:45.419225 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-bdeb0a18-9ccb-4e3e-9d41-0100a6da3235 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:45.427458 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bdeb0a18-9ccb-4e3e-9d41-0100a6da3235 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:45.427915 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bdeb0a18-9ccb-4e3e-9d41-0100a6da3235 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:45.428688 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bdeb0a18-9ccb-4e3e-9d41-0100a6da3235 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:45.429121 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bdeb0a18-9ccb-4e3e-9d41-0100a6da3235 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:45.635293 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-85fc0d5e-4758-4bd7-b974-d40f4bde0417 req-569a8402-c578-427d-9e45-b6d993bb3164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aea8cac-d69e-4467-9c2e-d38652fbf89f", "name": "network-vif-plugged", "status": "completed", "tag": "29a481fd-7c99-42e1-92d5-26fb61661a7d"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:09:45.636411 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bdeb0a18-9ccb-4e3e-9d41-0100a6da3235 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:45.637024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:09:45.637024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:09:45.645577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bdeb0a18-9ccb-4e3e-9d41-0100a6da3235 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:45.645761 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-85fc0d5e-4758-4bd7-b974-d40f4bde0417 req-569a8402-c578-427d-9e45-b6d993bb3164 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:45.646191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-85fc0d5e-4758-4bd7-b974-d40f4bde0417 req-569a8402-c578-427d-9e45-b6d993bb3164 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:45.647062 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bdeb0a18-9ccb-4e3e-9d41-0100a6da3235 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:45.648205 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-bdeb0a18-9ccb-4e3e-9d41-0100a6da3235 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1746 microversion: 2.20 time: 0.233332 Feb 28 19:09:45.652599 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 357/704] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:45 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1746 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:45.662927 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-85fc0d5e-4758-4bd7-b974-d40f4bde0417 req-569a8402-c578-427d-9e45-b6d993bb3164 service nova] Creating event network-vif-plugged:29a481fd-7c99-42e1-92d5-26fb61661a7d for instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f on hv-cinder-83118 Feb 28 19:09:45.668212 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-85fc0d5e-4758-4bd7-b974-d40f4bde0417 req-569a8402-c578-427d-9e45-b6d993bb3164 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036419 Feb 28 19:09:45.669085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 348/705] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:09:46.666500 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f2e2c58b-a422-4995-b297-4223aaca1400 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:46.667089 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f2e2c58b-a422-4995-b297-4223aaca1400 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:46.674314 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f2e2c58b-a422-4995-b297-4223aaca1400 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:46.674763 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f2e2c58b-a422-4995-b297-4223aaca1400 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:46.676202 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f2e2c58b-a422-4995-b297-4223aaca1400 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:46.676624 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f2e2c58b-a422-4995-b297-4223aaca1400 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:46.870346 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f2e2c58b-a422-4995-b297-4223aaca1400 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:46.879726 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f2e2c58b-a422-4995-b297-4223aaca1400 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:46.881284 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f2e2c58b-a422-4995-b297-4223aaca1400 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:46.882518 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f2e2c58b-a422-4995-b297-4223aaca1400 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1746 microversion: 2.20 time: 0.219510 Feb 28 19:09:46.883357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 358/706] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:46 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1746 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:09:47.905172 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0fd9d85a-0a97-4a4e-955e-e1b151d7ab17 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:47.906656 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0fd9d85a-0a97-4a4e-955e-e1b151d7ab17 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:47.915770 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0fd9d85a-0a97-4a4e-955e-e1b151d7ab17 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:47.918689 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0fd9d85a-0a97-4a4e-955e-e1b151d7ab17 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:47.919780 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0fd9d85a-0a97-4a4e-955e-e1b151d7ab17 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:47.920861 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0fd9d85a-0a97-4a4e-955e-e1b151d7ab17 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:48.167408 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0fd9d85a-0a97-4a4e-955e-e1b151d7ab17 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:48.177422 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0fd9d85a-0a97-4a4e-955e-e1b151d7ab17 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:48.178911 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0fd9d85a-0a97-4a4e-955e-e1b151d7ab17 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:48.180174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0fd9d85a-0a97-4a4e-955e-e1b151d7ab17 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1741 microversion: 2.20 time: 0.282361 Feb 28 19:09:48.180615 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 349/707] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:47 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1741 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:49.200533 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-383257c1-eae2-4b59-9f86-0e9dfe4a4960 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:49.201789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-383257c1-eae2-4b59-9f86-0e9dfe4a4960 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:49.210151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-383257c1-eae2-4b59-9f86-0e9dfe4a4960 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:49.210596 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-383257c1-eae2-4b59-9f86-0e9dfe4a4960 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:49.211417 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-383257c1-eae2-4b59-9f86-0e9dfe4a4960 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:49.211849 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-383257c1-eae2-4b59-9f86-0e9dfe4a4960 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:49.424406 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-383257c1-eae2-4b59-9f86-0e9dfe4a4960 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:49.434753 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-383257c1-eae2-4b59-9f86-0e9dfe4a4960 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:49.436731 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-383257c1-eae2-4b59-9f86-0e9dfe4a4960 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:49.437957 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-383257c1-eae2-4b59-9f86-0e9dfe4a4960 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1741 microversion: 2.20 time: 0.241167 Feb 28 19:09:49.450461 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 359/708] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:49 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1741 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:09:50.457494 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-147aff94-7357-4a4c-8b5f-8c619c94f4ff tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:50.458121 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-147aff94-7357-4a4c-8b5f-8c619c94f4ff tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:50.465819 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-147aff94-7357-4a4c-8b5f-8c619c94f4ff tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:50.466280 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-147aff94-7357-4a4c-8b5f-8c619c94f4ff tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:50.467092 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-147aff94-7357-4a4c-8b5f-8c619c94f4ff tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:50.467553 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-147aff94-7357-4a4c-8b5f-8c619c94f4ff tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:50.690988 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-147aff94-7357-4a4c-8b5f-8c619c94f4ff tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:50.702130 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-147aff94-7357-4a4c-8b5f-8c619c94f4ff tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:50.703686 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-147aff94-7357-4a4c-8b5f-8c619c94f4ff tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:50.704816 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-147aff94-7357-4a4c-8b5f-8c619c94f4ff tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1741 microversion: 2.20 time: 0.251270 Feb 28 19:09:50.705583 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 350/709] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:50 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:51.724079 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5f36c5ce-f9a6-48f8-a67e-fbc61558154a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:51.724784 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5f36c5ce-f9a6-48f8-a67e-fbc61558154a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:51.732384 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5f36c5ce-f9a6-48f8-a67e-fbc61558154a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:51.732838 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5f36c5ce-f9a6-48f8-a67e-fbc61558154a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:51.733697 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5f36c5ce-f9a6-48f8-a67e-fbc61558154a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:51.734140 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5f36c5ce-f9a6-48f8-a67e-fbc61558154a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:51.941232 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5f36c5ce-f9a6-48f8-a67e-fbc61558154a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:51.951470 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5f36c5ce-f9a6-48f8-a67e-fbc61558154a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:51.953087 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5f36c5ce-f9a6-48f8-a67e-fbc61558154a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:51.954700 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5f36c5ce-f9a6-48f8-a67e-fbc61558154a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1741 microversion: 2.20 time: 0.234215 Feb 28 19:09:51.955297 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 360/710] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:51 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:52.974789 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4d69a336-f282-4d80-9008-09bba368ed94 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:52.976878 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4d69a336-f282-4d80-9008-09bba368ed94 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:52.986901 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4d69a336-f282-4d80-9008-09bba368ed94 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:52.988033 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4d69a336-f282-4d80-9008-09bba368ed94 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:52.989568 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4d69a336-f282-4d80-9008-09bba368ed94 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:52.990119 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4d69a336-f282-4d80-9008-09bba368ed94 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:53.225214 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4d69a336-f282-4d80-9008-09bba368ed94 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:53.234101 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4d69a336-f282-4d80-9008-09bba368ed94 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:53.235888 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4d69a336-f282-4d80-9008-09bba368ed94 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:53.237121 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4d69a336-f282-4d80-9008-09bba368ed94 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1741 microversion: 2.20 time: 0.267443 Feb 28 19:09:53.238417 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 351/711] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:52 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1741 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:54.256653 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ff957f20-36d7-4a29-abfb-11a989271c88 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:54.257197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ff957f20-36d7-4a29-abfb-11a989271c88 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:54.264468 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff957f20-36d7-4a29-abfb-11a989271c88 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:54.264908 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff957f20-36d7-4a29-abfb-11a989271c88 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:54.265662 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff957f20-36d7-4a29-abfb-11a989271c88 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:54.266091 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff957f20-36d7-4a29-abfb-11a989271c88 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:54.472871 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ff957f20-36d7-4a29-abfb-11a989271c88 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:54.481651 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ff957f20-36d7-4a29-abfb-11a989271c88 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:54.483405 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ff957f20-36d7-4a29-abfb-11a989271c88 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:54.484523 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ff957f20-36d7-4a29-abfb-11a989271c88 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1741 microversion: 2.20 time: 0.232326 Feb 28 19:09:54.487097 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 361/712] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:54 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:55.503694 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b2d293ad-a4ea-4a07-a820-0b46b8d8d3cb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:55.504358 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b2d293ad-a4ea-4a07-a820-0b46b8d8d3cb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:55.511680 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b2d293ad-a4ea-4a07-a820-0b46b8d8d3cb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:55.512125 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b2d293ad-a4ea-4a07-a820-0b46b8d8d3cb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:55.512893 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b2d293ad-a4ea-4a07-a820-0b46b8d8d3cb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:55.513326 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b2d293ad-a4ea-4a07-a820-0b46b8d8d3cb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:55.719169 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b2d293ad-a4ea-4a07-a820-0b46b8d8d3cb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:55.728352 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b2d293ad-a4ea-4a07-a820-0b46b8d8d3cb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:55.729854 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b2d293ad-a4ea-4a07-a820-0b46b8d8d3cb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:55.730985 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b2d293ad-a4ea-4a07-a820-0b46b8d8d3cb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1741 microversion: 2.20 time: 0.231295 Feb 28 19:09:55.731871 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 352/713] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:55 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:56.749590 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-27be1618-af87-4e5e-904e-cdb7a39faa2f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:56.750241 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-27be1618-af87-4e5e-904e-cdb7a39faa2f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:56.757908 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-27be1618-af87-4e5e-904e-cdb7a39faa2f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:56.759107 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-27be1618-af87-4e5e-904e-cdb7a39faa2f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:56.759107 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-27be1618-af87-4e5e-904e-cdb7a39faa2f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:56.759457 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-27be1618-af87-4e5e-904e-cdb7a39faa2f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:57.011154 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-27be1618-af87-4e5e-904e-cdb7a39faa2f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:57.024223 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-27be1618-af87-4e5e-904e-cdb7a39faa2f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:57.024223 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-27be1618-af87-4e5e-904e-cdb7a39faa2f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:57.025049 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-27be1618-af87-4e5e-904e-cdb7a39faa2f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1741 microversion: 2.20 time: 0.278696 Feb 28 19:09:57.025602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 362/714] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:56 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1741 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:58.046313 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7e8782c6-5a34-47ac-9fb3-9ed895c1f9cf tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:58.046913 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7e8782c6-5a34-47ac-9fb3-9ed895c1f9cf tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:58.054628 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7e8782c6-5a34-47ac-9fb3-9ed895c1f9cf tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:58.055068 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7e8782c6-5a34-47ac-9fb3-9ed895c1f9cf tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:58.055853 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7e8782c6-5a34-47ac-9fb3-9ed895c1f9cf tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:58.056283 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7e8782c6-5a34-47ac-9fb3-9ed895c1f9cf tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:58.259639 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7e8782c6-5a34-47ac-9fb3-9ed895c1f9cf tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:58.269222 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7e8782c6-5a34-47ac-9fb3-9ed895c1f9cf tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:58.271797 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7e8782c6-5a34-47ac-9fb3-9ed895c1f9cf tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:58.272987 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7e8782c6-5a34-47ac-9fb3-9ed895c1f9cf tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1741 microversion: 2.20 time: 0.230409 Feb 28 19:09:58.283414 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 353/715] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:58 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:09:59.295961 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0d22d3bc-b087-4c69-8677-bb1233519496 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:09:59.296572 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0d22d3bc-b087-4c69-8677-bb1233519496 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:09:59.304555 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0d22d3bc-b087-4c69-8677-bb1233519496 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:59.312860 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0d22d3bc-b087-4c69-8677-bb1233519496 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:59.312860 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0d22d3bc-b087-4c69-8677-bb1233519496 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:09:59.312860 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0d22d3bc-b087-4c69-8677-bb1233519496 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:09:59.503780 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0d22d3bc-b087-4c69-8677-bb1233519496 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:59.512281 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0d22d3bc-b087-4c69-8677-bb1233519496 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:59.513775 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0d22d3bc-b087-4c69-8677-bb1233519496 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:09:59.514905 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0d22d3bc-b087-4c69-8677-bb1233519496 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1741 microversion: 2.20 time: 0.222651 Feb 28 19:09:59.515480 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 363/716] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:09:59 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:00.533467 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-22e1f776-3c9e-4760-9332-3adf6e813539 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:00.534184 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-22e1f776-3c9e-4760-9332-3adf6e813539 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:00.542110 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-22e1f776-3c9e-4760-9332-3adf6e813539 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:00.542638 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-22e1f776-3c9e-4760-9332-3adf6e813539 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:00.543578 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-22e1f776-3c9e-4760-9332-3adf6e813539 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:00.544114 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-22e1f776-3c9e-4760-9332-3adf6e813539 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:00.738026 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-22e1f776-3c9e-4760-9332-3adf6e813539 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:00.749889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-22e1f776-3c9e-4760-9332-3adf6e813539 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:00.751488 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-22e1f776-3c9e-4760-9332-3adf6e813539 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:00.752699 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-22e1f776-3c9e-4760-9332-3adf6e813539 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1723 microversion: 2.20 time: 0.223360 Feb 28 19:10:00.753333 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 354/717] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:00 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:01.771791 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-54fc846d-28cc-49d8-9a6e-42d2918f2863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:01.772406 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-54fc846d-28cc-49d8-9a6e-42d2918f2863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:01.779522 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-54fc846d-28cc-49d8-9a6e-42d2918f2863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:01.779958 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-54fc846d-28cc-49d8-9a6e-42d2918f2863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:01.780708 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-54fc846d-28cc-49d8-9a6e-42d2918f2863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:01.781140 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-54fc846d-28cc-49d8-9a6e-42d2918f2863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:01.976523 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-54fc846d-28cc-49d8-9a6e-42d2918f2863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:01.985206 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-54fc846d-28cc-49d8-9a6e-42d2918f2863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:01.986686 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-54fc846d-28cc-49d8-9a6e-42d2918f2863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:01.987824 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-54fc846d-28cc-49d8-9a6e-42d2918f2863 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1723 microversion: 2.20 time: 0.219831 Feb 28 19:10:01.988415 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 364/718] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:01 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:03.006508 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-802d9acd-2c09-4abd-a64f-3f5cdc5de79a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:03.007133 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-802d9acd-2c09-4abd-a64f-3f5cdc5de79a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:03.014452 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-802d9acd-2c09-4abd-a64f-3f5cdc5de79a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:03.014898 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-802d9acd-2c09-4abd-a64f-3f5cdc5de79a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:03.015694 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-802d9acd-2c09-4abd-a64f-3f5cdc5de79a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:03.016128 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-802d9acd-2c09-4abd-a64f-3f5cdc5de79a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:03.364173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-802d9acd-2c09-4abd-a64f-3f5cdc5de79a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:03.373152 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-802d9acd-2c09-4abd-a64f-3f5cdc5de79a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:03.374799 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-802d9acd-2c09-4abd-a64f-3f5cdc5de79a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:03.375917 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-802d9acd-2c09-4abd-a64f-3f5cdc5de79a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1723 microversion: 2.20 time: 0.374086 Feb 28 19:10:03.376452 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 355/719] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:03 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:03.656848 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-3e84129b-5790-400e-af30-e4e383e4df6c req-a8255530-6828-4659-8f09-581086264441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aea8cac-d69e-4467-9c2e-d38652fbf89f", "name": "network-vif-unplugged", "status": "completed", "tag": "29a481fd-7c99-42e1-92d5-26fb61661a7d"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:10:03.656848 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:10:03.656848 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:10:03.664201 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-3e84129b-5790-400e-af30-e4e383e4df6c req-a8255530-6828-4659-8f09-581086264441 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:03.664635 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-3e84129b-5790-400e-af30-e4e383e4df6c req-a8255530-6828-4659-8f09-581086264441 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:03.683101 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-3e84129b-5790-400e-af30-e4e383e4df6c req-a8255530-6828-4659-8f09-581086264441 service nova] Creating event network-vif-unplugged:29a481fd-7c99-42e1-92d5-26fb61661a7d for instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f on hv-cinder-83118 Feb 28 19:10:03.688124 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-3e84129b-5790-400e-af30-e4e383e4df6c req-a8255530-6828-4659-8f09-581086264441 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038105 Feb 28 19:10:03.693706 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 365/720] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:10:04.394093 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0f1e9085-c4a5-4dc9-ad41-ab396e84d804 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:04.395322 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0f1e9085-c4a5-4dc9-ad41-ab396e84d804 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:04.402446 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0f1e9085-c4a5-4dc9-ad41-ab396e84d804 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:04.402897 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0f1e9085-c4a5-4dc9-ad41-ab396e84d804 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:04.403698 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0f1e9085-c4a5-4dc9-ad41-ab396e84d804 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:04.404131 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0f1e9085-c4a5-4dc9-ad41-ab396e84d804 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:04.595765 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0f1e9085-c4a5-4dc9-ad41-ab396e84d804 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:04.604562 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0f1e9085-c4a5-4dc9-ad41-ab396e84d804 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:04.606050 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0f1e9085-c4a5-4dc9-ad41-ab396e84d804 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:04.607148 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0f1e9085-c4a5-4dc9-ad41-ab396e84d804 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1666 microversion: 2.20 time: 0.216774 Feb 28 19:10:04.607693 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 356/721] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:04 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1666 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:04.624948 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-abf07037-840e-4c8b-ac77-b793615da739 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f14049d-ea72-4e41-833a-169974789f6c"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:10:04.626083 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-abf07037-840e-4c8b-ac77-b793615da739 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:04.634320 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-abf07037-840e-4c8b-ac77-b793615da739 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:04.634765 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-abf07037-840e-4c8b-ac77-b793615da739 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:04.635562 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-abf07037-840e-4c8b-ac77-b793615da739 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:04.635995 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-abf07037-840e-4c8b-ac77-b793615da739 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:06.012637 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-abf07037-840e-4c8b-ac77-b793615da739 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "POST /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.391800 Feb 28 19:10:06.013359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 366/722] 10.222.0.21 () {62 vars in 1363 bytes} [Mon Feb 28 19:10:04 2022] POST /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/os-volume_attachments => generated 188 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 28 19:10:06.196178 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8e1a97f0-dfb8-447a-843b-85401411f8b7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:06.196696 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8e1a97f0-dfb8-447a-843b-85401411f8b7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:06.203805 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e1a97f0-dfb8-447a-843b-85401411f8b7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:06.204252 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e1a97f0-dfb8-447a-843b-85401411f8b7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:06.205011 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e1a97f0-dfb8-447a-843b-85401411f8b7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:06.205440 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e1a97f0-dfb8-447a-843b-85401411f8b7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:06.972993 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8e1a97f0-dfb8-447a-843b-85401411f8b7 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/os-volume_attachments/4f14049d-ea72-4e41-833a-169974789f6c" status: 202 len: 0 microversion: 2.20 time: 0.779930 Feb 28 19:10:06.973601 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 357/723] 10.222.0.21 () {60 vars in 1456 bytes} [Mon Feb 28 19:10:06 2022] DELETE /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/os-volume_attachments/4f14049d-ea72-4e41-833a-169974789f6c => generated 0 bytes in 782 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:10:07.060479 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-dd6a2cac-209c-4169-b98d-cc1733635044 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:10:07.061055 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-dd6a2cac-209c-4169-b98d-cc1733635044 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:07.069052 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dd6a2cac-209c-4169-b98d-cc1733635044 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:07.069502 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dd6a2cac-209c-4169-b98d-cc1733635044 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:07.070276 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dd6a2cac-209c-4169-b98d-cc1733635044 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:07.070716 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dd6a2cac-209c-4169-b98d-cc1733635044 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:07.392411 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-dd6a2cac-209c-4169-b98d-cc1733635044 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "POST /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/action" status: 202 len: 0 microversion: 2.20 time: 0.335808 Feb 28 19:10:07.395317 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 367/724] 10.222.0.21 () {62 vars in 1318 bytes} [Mon Feb 28 19:10:07 2022] POST /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:10:07.401770 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-65a548a5-2696-4961-a9b8-2e52ac7f2e2b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:07.402378 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-65a548a5-2696-4961-a9b8-2e52ac7f2e2b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:07.410708 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-65a548a5-2696-4961-a9b8-2e52ac7f2e2b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:07.411163 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-65a548a5-2696-4961-a9b8-2e52ac7f2e2b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:07.411946 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-65a548a5-2696-4961-a9b8-2e52ac7f2e2b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:07.412381 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-65a548a5-2696-4961-a9b8-2e52ac7f2e2b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:07.695867 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c00b0ef8-9b69-4345-b0f0-274c07a83d97 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:07.696710 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c00b0ef8-9b69-4345-b0f0-274c07a83d97 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:07.704489 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c00b0ef8-9b69-4345-b0f0-274c07a83d97 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:07.704706 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-65a548a5-2696-4961-a9b8-2e52ac7f2e2b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:07.705417 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c00b0ef8-9b69-4345-b0f0-274c07a83d97 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:07.706360 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c00b0ef8-9b69-4345-b0f0-274c07a83d97 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:07.706897 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c00b0ef8-9b69-4345-b0f0-274c07a83d97 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:07.719285 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-65a548a5-2696-4961-a9b8-2e52ac7f2e2b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:07.720873 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-65a548a5-2696-4961-a9b8-2e52ac7f2e2b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:07.722141 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-65a548a5-2696-4961-a9b8-2e52ac7f2e2b tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1674 microversion: 2.20 time: 0.324025 Feb 28 19:10:07.722715 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 358/725] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:07 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1674 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:07.773299 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c00b0ef8-9b69-4345-b0f0-274c07a83d97 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments/7bf34700-e366-4c39-bae2-08b40cca9a18" status: 200 len: 194 microversion: 2.1 time: 0.082431 Feb 28 19:10:07.773873 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 368/726] 10.222.0.21 () {58 vars in 1412 bytes} [Mon Feb 28 19:10:07 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments/7bf34700-e366-4c39-bae2-08b40cca9a18 => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:10:07.783476 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-91251c19-f533-4420-9a28-be17698d1e62 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:07.783964 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-91251c19-f533-4420-9a28-be17698d1e62 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:07.791957 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-91251c19-f533-4420-9a28-be17698d1e62 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:07.797389 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-91251c19-f533-4420-9a28-be17698d1e62 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:07.797389 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-91251c19-f533-4420-9a28-be17698d1e62 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:07.797389 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-91251c19-f533-4420-9a28-be17698d1e62 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:07.949359 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-91251c19-f533-4420-9a28-be17698d1e62 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lazy-loading 'services' on Instance uuid 970b2934-fe16-4039-9044-1e31b3217360 {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:10:08.302543 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-91251c19-f533-4420-9a28-be17698d1e62 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "DELETE /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments/7bf34700-e366-4c39-bae2-08b40cca9a18" status: 202 len: 0 microversion: 2.1 time: 0.522765 Feb 28 19:10:08.303213 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 359/727] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:10:07 2022] DELETE /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments/7bf34700-e366-4c39-bae2-08b40cca9a18 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:10:08.742092 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b6082afd-1776-410e-b1c0-aa04ab866418 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:08.742707 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b6082afd-1776-410e-b1c0-aa04ab866418 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:08.749812 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6082afd-1776-410e-b1c0-aa04ab866418 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:08.754619 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6082afd-1776-410e-b1c0-aa04ab866418 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:08.754619 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6082afd-1776-410e-b1c0-aa04ab866418 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:08.754619 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6082afd-1776-410e-b1c0-aa04ab866418 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:08.952532 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b6082afd-1776-410e-b1c0-aa04ab866418 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:08.961543 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b6082afd-1776-410e-b1c0-aa04ab866418 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:08.963075 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b6082afd-1776-410e-b1c0-aa04ab866418 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:08.964233 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b6082afd-1776-410e-b1c0-aa04ab866418 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1674 microversion: 2.20 time: 0.226431 Feb 28 19:10:08.965147 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 369/728] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:08 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1674 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:09.982363 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c30ed114-9e8e-42a0-b629-3930739d681d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:09.983126 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c30ed114-9e8e-42a0-b629-3930739d681d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:09.991073 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c30ed114-9e8e-42a0-b629-3930739d681d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:09.991551 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c30ed114-9e8e-42a0-b629-3930739d681d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:09.992327 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c30ed114-9e8e-42a0-b629-3930739d681d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:09.992757 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c30ed114-9e8e-42a0-b629-3930739d681d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:10.193147 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c30ed114-9e8e-42a0-b629-3930739d681d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:10.201847 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c30ed114-9e8e-42a0-b629-3930739d681d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:10.203355 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c30ed114-9e8e-42a0-b629-3930739d681d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:10.204475 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c30ed114-9e8e-42a0-b629-3930739d681d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.226365 Feb 28 19:10:10.205024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 360/729] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:09 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:10.561360 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-bcd174d3-5a19-433e-8dc5-a2494664a292 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:10.561955 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-bcd174d3-5a19-433e-8dc5-a2494664a292 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:10.570186 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bcd174d3-5a19-433e-8dc5-a2494664a292 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:10.570632 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bcd174d3-5a19-433e-8dc5-a2494664a292 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:10.571451 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bcd174d3-5a19-433e-8dc5-a2494664a292 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:10.571885 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bcd174d3-5a19-433e-8dc5-a2494664a292 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:10.635687 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-bcd174d3-5a19-433e-8dc5-a2494664a292 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments/a0974d49-bba1-4027-ae93-80ea291b2a23" status: 200 len: 194 microversion: 2.1 time: 0.078193 Feb 28 19:10:10.636264 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 370/730] 10.222.0.21 () {58 vars in 1412 bytes} [Mon Feb 28 19:10:10 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments/a0974d49-bba1-4027-ae93-80ea291b2a23 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:10:10.646486 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-67064ee0-781a-41c5-9fbb-a9f66491b612 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:10.646976 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-67064ee0-781a-41c5-9fbb-a9f66491b612 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:10.655029 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-67064ee0-781a-41c5-9fbb-a9f66491b612 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:10.655510 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-67064ee0-781a-41c5-9fbb-a9f66491b612 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:10.656291 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-67064ee0-781a-41c5-9fbb-a9f66491b612 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:10.656713 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-67064ee0-781a-41c5-9fbb-a9f66491b612 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:10.658832 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8ce5fc6a-da18-4f39-bf8c-638b74e29cb9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:10.659363 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8ce5fc6a-da18-4f39-bf8c-638b74e29cb9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:10.668008 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ce5fc6a-da18-4f39-bf8c-638b74e29cb9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:10.668008 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ce5fc6a-da18-4f39-bf8c-638b74e29cb9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:10.668443 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ce5fc6a-da18-4f39-bf8c-638b74e29cb9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:10.668881 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8ce5fc6a-da18-4f39-bf8c-638b74e29cb9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:10.733852 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8ce5fc6a-da18-4f39-bf8c-638b74e29cb9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Going to try to terminate instance {{(pid=101791) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:10:10.817509 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-67064ee0-781a-41c5-9fbb-a9f66491b612 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lazy-loading 'services' on Instance uuid 970b2934-fe16-4039-9044-1e31b3217360 {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:10:11.152705 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8ce5fc6a-da18-4f39-bf8c-638b74e29cb9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "DELETE /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 204 len: 0 microversion: 2.1 time: 0.497539 Feb 28 19:10:11.160778 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 371/731] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:10:10 2022] DELETE /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 28 19:10:11.169296 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d33f8543-784d-44c3-a6ef-41dd31a0c6ce tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:11.170761 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d33f8543-784d-44c3-a6ef-41dd31a0c6ce tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:11.186801 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d33f8543-784d-44c3-a6ef-41dd31a0c6ce tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:11.187012 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-67064ee0-781a-41c5-9fbb-a9f66491b612 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "DELETE /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments/a0974d49-bba1-4027-ae93-80ea291b2a23" status: 202 len: 0 microversion: 2.1 time: 0.542181 Feb 28 19:10:11.187012 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 361/732] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:10:10 2022] DELETE /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments/a0974d49-bba1-4027-ae93-80ea291b2a23 => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:10:11.187593 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d33f8543-784d-44c3-a6ef-41dd31a0c6ce tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:11.188736 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d33f8543-784d-44c3-a6ef-41dd31a0c6ce tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:11.189482 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d33f8543-784d-44c3-a6ef-41dd31a0c6ce tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:11.232202 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1a3ffda3-d541-4743-9da9-a3d5202181e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:11.232908 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1a3ffda3-d541-4743-9da9-a3d5202181e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:11.253636 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1a3ffda3-d541-4743-9da9-a3d5202181e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:11.254091 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1a3ffda3-d541-4743-9da9-a3d5202181e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:11.254875 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1a3ffda3-d541-4743-9da9-a3d5202181e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:11.255336 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1a3ffda3-d541-4743-9da9-a3d5202181e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:11.588661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d33f8543-784d-44c3-a6ef-41dd31a0c6ce tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:11.599973 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d33f8543-784d-44c3-a6ef-41dd31a0c6ce tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.436263 Feb 28 19:10:11.600139 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1a3ffda3-d541-4743-9da9-a3d5202181e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:11.611393 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 372/733] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:11 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:10:11.618244 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1a3ffda3-d541-4743-9da9-a3d5202181e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:11.619780 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1a3ffda3-d541-4743-9da9-a3d5202181e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:11.620920 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1a3ffda3-d541-4743-9da9-a3d5202181e6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.401577 Feb 28 19:10:11.621473 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 362/734] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:11 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:12.620138 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-da0a03c8-aaa2-41c4-8214-bf6a71bc5fc2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:12.620138 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-da0a03c8-aaa2-41c4-8214-bf6a71bc5fc2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:12.625772 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da0a03c8-aaa2-41c4-8214-bf6a71bc5fc2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:12.627358 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da0a03c8-aaa2-41c4-8214-bf6a71bc5fc2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:12.628209 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da0a03c8-aaa2-41c4-8214-bf6a71bc5fc2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:12.628658 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da0a03c8-aaa2-41c4-8214-bf6a71bc5fc2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:12.649069 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8e93f397-19a2-43a1-a4db-86462ad0df46 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:12.650513 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8e93f397-19a2-43a1-a4db-86462ad0df46 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:12.660632 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e93f397-19a2-43a1-a4db-86462ad0df46 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:12.666167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e93f397-19a2-43a1-a4db-86462ad0df46 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:12.666167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e93f397-19a2-43a1-a4db-86462ad0df46 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:12.666167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8e93f397-19a2-43a1-a4db-86462ad0df46 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:12.906221 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-da0a03c8-aaa2-41c4-8214-bf6a71bc5fc2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:12.923866 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-da0a03c8-aaa2-41c4-8214-bf6a71bc5fc2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.310233 Feb 28 19:10:12.935184 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 373/735] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:12 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:12.997447 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8e93f397-19a2-43a1-a4db-86462ad0df46 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:13.006554 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8e93f397-19a2-43a1-a4db-86462ad0df46 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:13.008072 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8e93f397-19a2-43a1-a4db-86462ad0df46 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:13.009198 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8e93f397-19a2-43a1-a4db-86462ad0df46 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.374318 Feb 28 19:10:13.009758 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 363/736] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:12 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:13.942357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2f0cc4ad-5fc6-4dc5-8b93-f9c8e20b22b9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:13.942962 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-2f0cc4ad-5fc6-4dc5-8b93-f9c8e20b22b9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:13.951939 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2f0cc4ad-5fc6-4dc5-8b93-f9c8e20b22b9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:13.952632 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2f0cc4ad-5fc6-4dc5-8b93-f9c8e20b22b9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:13.953615 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2f0cc4ad-5fc6-4dc5-8b93-f9c8e20b22b9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:13.954081 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2f0cc4ad-5fc6-4dc5-8b93-f9c8e20b22b9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:14.030064 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-49b83033-83e4-438b-91ec-babe08f33a14 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:14.031347 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-49b83033-83e4-438b-91ec-babe08f33a14 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:14.039898 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49b83033-83e4-438b-91ec-babe08f33a14 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:14.040604 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49b83033-83e4-438b-91ec-babe08f33a14 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:14.041401 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49b83033-83e4-438b-91ec-babe08f33a14 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:14.041831 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-49b83033-83e4-438b-91ec-babe08f33a14 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:14.235340 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-2f0cc4ad-5fc6-4dc5-8b93-f9c8e20b22b9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:14.244518 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2f0cc4ad-5fc6-4dc5-8b93-f9c8e20b22b9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.306460 Feb 28 19:10:14.248620 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 374/737] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:13 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:14.310811 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-49b83033-83e4-438b-91ec-babe08f33a14 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:14.320910 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-49b83033-83e4-438b-91ec-babe08f33a14 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:14.322396 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-49b83033-83e4-438b-91ec-babe08f33a14 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:14.323559 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-49b83033-83e4-438b-91ec-babe08f33a14 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.297966 Feb 28 19:10:14.327165 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 364/738] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:14 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:15.261481 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d936e587-1938-42e3-b576-6d1d99b913d2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:15.262723 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d936e587-1938-42e3-b576-6d1d99b913d2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:15.271004 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d936e587-1938-42e3-b576-6d1d99b913d2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:15.271477 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d936e587-1938-42e3-b576-6d1d99b913d2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:15.272253 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d936e587-1938-42e3-b576-6d1d99b913d2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:15.272680 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d936e587-1938-42e3-b576-6d1d99b913d2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:15.342095 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6d802163-642d-41b9-a639-069690cfe091 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:15.342662 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6d802163-642d-41b9-a639-069690cfe091 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:15.350740 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d802163-642d-41b9-a639-069690cfe091 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:15.351340 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d802163-642d-41b9-a639-069690cfe091 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:15.352143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d802163-642d-41b9-a639-069690cfe091 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:15.352791 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d802163-642d-41b9-a639-069690cfe091 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:15.612830 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d936e587-1938-42e3-b576-6d1d99b913d2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:15.622470 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d936e587-1938-42e3-b576-6d1d99b913d2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.365003 Feb 28 19:10:15.623044 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 375/739] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:15 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:15.630255 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6d802163-642d-41b9-a639-069690cfe091 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:15.640041 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6d802163-642d-41b9-a639-069690cfe091 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:15.641555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6d802163-642d-41b9-a639-069690cfe091 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:15.645062 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6d802163-642d-41b9-a639-069690cfe091 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.304315 Feb 28 19:10:15.646853 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 365/740] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:15 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:16.648148 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f4ef21fd-fcdc-4c03-af2f-f972fd0d4497 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:16.648868 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f4ef21fd-fcdc-4c03-af2f-f972fd0d4497 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:16.656186 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f4ef21fd-fcdc-4c03-af2f-f972fd0d4497 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:16.656919 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f4ef21fd-fcdc-4c03-af2f-f972fd0d4497 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:16.657950 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f4ef21fd-fcdc-4c03-af2f-f972fd0d4497 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:16.658418 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f4ef21fd-fcdc-4c03-af2f-f972fd0d4497 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:16.663074 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e5faebf0-a626-4de2-b541-c5dfc8ae6c95 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:16.664158 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e5faebf0-a626-4de2-b541-c5dfc8ae6c95 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:16.672114 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e5faebf0-a626-4de2-b541-c5dfc8ae6c95 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:16.672559 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e5faebf0-a626-4de2-b541-c5dfc8ae6c95 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:16.673559 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e5faebf0-a626-4de2-b541-c5dfc8ae6c95 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:16.674212 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e5faebf0-a626-4de2-b541-c5dfc8ae6c95 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:16.978204 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f4ef21fd-fcdc-4c03-af2f-f972fd0d4497 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:16.987444 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f4ef21fd-fcdc-4c03-af2f-f972fd0d4497 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.343425 Feb 28 19:10:16.999297 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 376/741] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:16 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:17.009193 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e5faebf0-a626-4de2-b541-c5dfc8ae6c95 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:17.020017 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e5faebf0-a626-4de2-b541-c5dfc8ae6c95 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:17.021625 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e5faebf0-a626-4de2-b541-c5dfc8ae6c95 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:17.022802 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e5faebf0-a626-4de2-b541-c5dfc8ae6c95 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.364635 Feb 28 19:10:17.024952 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 366/742] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:16 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:18.007770 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-68691a5a-0b98-4a18-a9a1-e08337e9c9e3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:18.008436 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-68691a5a-0b98-4a18-a9a1-e08337e9c9e3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:18.022476 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68691a5a-0b98-4a18-a9a1-e08337e9c9e3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:18.022476 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68691a5a-0b98-4a18-a9a1-e08337e9c9e3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:18.022476 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68691a5a-0b98-4a18-a9a1-e08337e9c9e3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:18.022476 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68691a5a-0b98-4a18-a9a1-e08337e9c9e3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:18.043837 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f3cea4ab-6b27-4ed9-96fb-b19f893d220e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:18.044463 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f3cea4ab-6b27-4ed9-96fb-b19f893d220e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:18.056015 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f3cea4ab-6b27-4ed9-96fb-b19f893d220e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:18.056478 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f3cea4ab-6b27-4ed9-96fb-b19f893d220e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:18.057267 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f3cea4ab-6b27-4ed9-96fb-b19f893d220e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:18.057707 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f3cea4ab-6b27-4ed9-96fb-b19f893d220e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:18.423418 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-68691a5a-0b98-4a18-a9a1-e08337e9c9e3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:18.423565 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f3cea4ab-6b27-4ed9-96fb-b19f893d220e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:18.423678 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-68691a5a-0b98-4a18-a9a1-e08337e9c9e3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.396664 Feb 28 19:10:18.423678 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 377/743] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:18 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:18.423856 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f3cea4ab-6b27-4ed9-96fb-b19f893d220e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:18.423856 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f3cea4ab-6b27-4ed9-96fb-b19f893d220e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:18.423856 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f3cea4ab-6b27-4ed9-96fb-b19f893d220e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.371114 Feb 28 19:10:18.424170 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 367/744] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:18 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:19.435629 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-bc8ddc9d-1e12-48ba-b488-87526b10f514 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:19.436604 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-bc8ddc9d-1e12-48ba-b488-87526b10f514 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:19.441869 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-46bef6fd-951b-4c12-ba16-c5baae733c1a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:19.443736 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-46bef6fd-951b-4c12-ba16-c5baae733c1a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:19.445519 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bc8ddc9d-1e12-48ba-b488-87526b10f514 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:19.445970 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bc8ddc9d-1e12-48ba-b488-87526b10f514 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:19.446761 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bc8ddc9d-1e12-48ba-b488-87526b10f514 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:19.447219 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bc8ddc9d-1e12-48ba-b488-87526b10f514 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:19.453569 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-46bef6fd-951b-4c12-ba16-c5baae733c1a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:19.454016 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-46bef6fd-951b-4c12-ba16-c5baae733c1a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:19.454848 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-46bef6fd-951b-4c12-ba16-c5baae733c1a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:19.455443 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-46bef6fd-951b-4c12-ba16-c5baae733c1a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:19.773482 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bc8ddc9d-1e12-48ba-b488-87526b10f514 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:19.781804 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-bc8ddc9d-1e12-48ba-b488-87526b10f514 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.349961 Feb 28 19:10:19.783058 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 378/745] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:19 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:19.786966 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-46bef6fd-951b-4c12-ba16-c5baae733c1a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:19.796959 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-46bef6fd-951b-4c12-ba16-c5baae733c1a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:19.798572 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-46bef6fd-951b-4c12-ba16-c5baae733c1a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:19.799822 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-46bef6fd-951b-4c12-ba16-c5baae733c1a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.362672 Feb 28 19:10:19.800377 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 368/746] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:19 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:20.805041 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-da6f97a4-1edf-4bdf-81bd-0ead0db755d5 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:20.805663 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-da6f97a4-1edf-4bdf-81bd-0ead0db755d5 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:20.812833 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da6f97a4-1edf-4bdf-81bd-0ead0db755d5 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:20.813277 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da6f97a4-1edf-4bdf-81bd-0ead0db755d5 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:20.814044 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da6f97a4-1edf-4bdf-81bd-0ead0db755d5 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:20.814478 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-da6f97a4-1edf-4bdf-81bd-0ead0db755d5 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:20.817624 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6494e3ec-32b7-4095-8cfa-d9b0b766d315 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:20.818399 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6494e3ec-32b7-4095-8cfa-d9b0b766d315 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:20.825573 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6494e3ec-32b7-4095-8cfa-d9b0b766d315 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:20.826013 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6494e3ec-32b7-4095-8cfa-d9b0b766d315 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:20.826770 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6494e3ec-32b7-4095-8cfa-d9b0b766d315 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:20.827225 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6494e3ec-32b7-4095-8cfa-d9b0b766d315 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:21.196100 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6494e3ec-32b7-4095-8cfa-d9b0b766d315 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:21.200900 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-da6f97a4-1edf-4bdf-81bd-0ead0db755d5 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:21.205476 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6494e3ec-32b7-4095-8cfa-d9b0b766d315 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:21.207033 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6494e3ec-32b7-4095-8cfa-d9b0b766d315 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:21.208943 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6494e3ec-32b7-4095-8cfa-d9b0b766d315 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.395099 Feb 28 19:10:21.209694 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 369/747] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:20 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:21.209920 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-da6f97a4-1edf-4bdf-81bd-0ead0db755d5 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.408470 Feb 28 19:10:21.219775 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 379/748] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:20 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:22.227204 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-11b3ff91-f6d1-46b6-b44e-10f90bfaea5e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:22.227814 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a197257c-ec22-4d55-a995-a1f9f762ccd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:22.228214 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-11b3ff91-f6d1-46b6-b44e-10f90bfaea5e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:22.228328 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a197257c-ec22-4d55-a995-a1f9f762ccd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:22.235702 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a197257c-ec22-4d55-a995-a1f9f762ccd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:22.236004 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-11b3ff91-f6d1-46b6-b44e-10f90bfaea5e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:22.236125 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a197257c-ec22-4d55-a995-a1f9f762ccd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:22.236531 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-11b3ff91-f6d1-46b6-b44e-10f90bfaea5e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:22.236835 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a197257c-ec22-4d55-a995-a1f9f762ccd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:22.237298 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a197257c-ec22-4d55-a995-a1f9f762ccd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:22.237709 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-11b3ff91-f6d1-46b6-b44e-10f90bfaea5e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:22.238201 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-11b3ff91-f6d1-46b6-b44e-10f90bfaea5e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:22.539404 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a197257c-ec22-4d55-a995-a1f9f762ccd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:22.541845 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-11b3ff91-f6d1-46b6-b44e-10f90bfaea5e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:22.548072 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a197257c-ec22-4d55-a995-a1f9f762ccd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:22.549577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a197257c-ec22-4d55-a995-a1f9f762ccd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:22.549767 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-11b3ff91-f6d1-46b6-b44e-10f90bfaea5e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.326323 Feb 28 19:10:22.550323 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 370/749] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:22 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:22.551043 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a197257c-ec22-4d55-a995-a1f9f762ccd2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.327230 Feb 28 19:10:22.551796 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 380/750] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:22 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:23.566875 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e9928429-3ad7-4452-a6eb-a06c1ac2488c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:23.567668 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e9928429-3ad7-4452-a6eb-a06c1ac2488c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:23.568934 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b5da40b9-d9f1-4e34-bb5a-5b516cea888d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:23.569548 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b5da40b9-d9f1-4e34-bb5a-5b516cea888d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:23.575253 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e9928429-3ad7-4452-a6eb-a06c1ac2488c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:23.575704 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e9928429-3ad7-4452-a6eb-a06c1ac2488c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:23.576663 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e9928429-3ad7-4452-a6eb-a06c1ac2488c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:23.576902 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e9928429-3ad7-4452-a6eb-a06c1ac2488c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:23.577221 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b5da40b9-d9f1-4e34-bb5a-5b516cea888d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:23.577666 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b5da40b9-d9f1-4e34-bb5a-5b516cea888d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:23.578450 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b5da40b9-d9f1-4e34-bb5a-5b516cea888d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:23.578891 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b5da40b9-d9f1-4e34-bb5a-5b516cea888d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:23.870061 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e9928429-3ad7-4452-a6eb-a06c1ac2488c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:23.877177 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b5da40b9-d9f1-4e34-bb5a-5b516cea888d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:23.878540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e9928429-3ad7-4452-a6eb-a06c1ac2488c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.315548 Feb 28 19:10:23.880292 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 371/751] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:23 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:23.887472 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b5da40b9-d9f1-4e34-bb5a-5b516cea888d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:23.888971 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b5da40b9-d9f1-4e34-bb5a-5b516cea888d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:23.890152 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b5da40b9-d9f1-4e34-bb5a-5b516cea888d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.325045 Feb 28 19:10:23.890711 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 381/752] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:23 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:24.896412 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-272159e5-f9f4-44d0-a82f-5bf56a825bdd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:24.897024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-272159e5-f9f4-44d0-a82f-5bf56a825bdd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:24.904212 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-272159e5-f9f4-44d0-a82f-5bf56a825bdd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:24.904660 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-272159e5-f9f4-44d0-a82f-5bf56a825bdd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:24.905427 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-272159e5-f9f4-44d0-a82f-5bf56a825bdd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:24.905863 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-272159e5-f9f4-44d0-a82f-5bf56a825bdd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:24.908388 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1eae8cae-a79f-4832-a88b-b97ba8b4daf3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:24.908993 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1eae8cae-a79f-4832-a88b-b97ba8b4daf3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:24.917299 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1eae8cae-a79f-4832-a88b-b97ba8b4daf3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:24.917990 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1eae8cae-a79f-4832-a88b-b97ba8b4daf3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:24.918950 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1eae8cae-a79f-4832-a88b-b97ba8b4daf3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:24.919835 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1eae8cae-a79f-4832-a88b-b97ba8b4daf3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:25.221527 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1eae8cae-a79f-4832-a88b-b97ba8b4daf3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:25.226324 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-272159e5-f9f4-44d0-a82f-5bf56a825bdd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:25.231707 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1eae8cae-a79f-4832-a88b-b97ba8b4daf3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:25.233246 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1eae8cae-a79f-4832-a88b-b97ba8b4daf3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:25.234374 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1eae8cae-a79f-4832-a88b-b97ba8b4daf3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.330055 Feb 28 19:10:25.234617 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-272159e5-f9f4-44d0-a82f-5bf56a825bdd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.341832 Feb 28 19:10:25.234962 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 382/753] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:24 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:25.235774 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 372/754] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:24 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:25.658232 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9fc257e6-1840-4bbe-912b-7e1083095a6f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:25.659364 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9fc257e6-1840-4bbe-912b-7e1083095a6f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:25.667080 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9fc257e6-1840-4bbe-912b-7e1083095a6f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:25.667552 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9fc257e6-1840-4bbe-912b-7e1083095a6f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:25.668329 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9fc257e6-1840-4bbe-912b-7e1083095a6f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:25.668794 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9fc257e6-1840-4bbe-912b-7e1083095a6f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:25.732981 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9fc257e6-1840-4bbe-912b-7e1083095a6f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078641 Feb 28 19:10:25.733549 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 383/755] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:10:25 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 19:10:25.901621 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0da8956b-e2a4-4e6c-a9e6-7a6b7b0b3fa6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:25.902615 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0da8956b-e2a4-4e6c-a9e6-7a6b7b0b3fa6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:25.909973 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0da8956b-e2a4-4e6c-a9e6-7a6b7b0b3fa6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:25.910414 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0da8956b-e2a4-4e6c-a9e6-7a6b7b0b3fa6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:25.911198 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0da8956b-e2a4-4e6c-a9e6-7a6b7b0b3fa6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:25.911802 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0da8956b-e2a4-4e6c-a9e6-7a6b7b0b3fa6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:25.975369 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0da8956b-e2a4-4e6c-a9e6-7a6b7b0b3fa6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077385 Feb 28 19:10:25.976112 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 373/756] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:10:25 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 19:10:26.065280 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-022716d8-6fd1-463b-aab9-c0495eeb369c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:26.065806 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-022716d8-6fd1-463b-aab9-c0495eeb369c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:26.073845 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-022716d8-6fd1-463b-aab9-c0495eeb369c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:26.074299 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-022716d8-6fd1-463b-aab9-c0495eeb369c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:26.075076 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-022716d8-6fd1-463b-aab9-c0495eeb369c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:26.075537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-022716d8-6fd1-463b-aab9-c0495eeb369c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:26.139371 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-022716d8-6fd1-463b-aab9-c0495eeb369c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Going to try to terminate instance {{(pid=101791) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:10:26.251689 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-504fab03-b10e-4df2-9cce-1059f58d3128 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:26.252436 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-504fab03-b10e-4df2-9cce-1059f58d3128 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:26.260926 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-504fab03-b10e-4df2-9cce-1059f58d3128 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:26.261364 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-504fab03-b10e-4df2-9cce-1059f58d3128 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:26.262129 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-504fab03-b10e-4df2-9cce-1059f58d3128 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:26.262556 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-504fab03-b10e-4df2-9cce-1059f58d3128 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:26.464385 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-504fab03-b10e-4df2-9cce-1059f58d3128 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:26.472560 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-504fab03-b10e-4df2-9cce-1059f58d3128 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1577 microversion: 2.1 time: 0.225024 Feb 28 19:10:26.473154 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 374/757] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:26 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:10:26.475506 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-022716d8-6fd1-463b-aab9-c0495eeb369c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "DELETE /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 204 len: 0 microversion: 2.1 time: 0.413554 Feb 28 19:10:26.476262 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 384/758] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:10:26 2022] DELETE /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:10:26.479568 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-de15900e-a5b2-4ccd-8944-2ec259a2420a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:26.479568 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-de15900e-a5b2-4ccd-8944-2ec259a2420a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:26.484885 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-704a589e-a0a5-4cb8-922f-3227701e8804 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:26.485296 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de15900e-a5b2-4ccd-8944-2ec259a2420a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:26.485595 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-704a589e-a0a5-4cb8-922f-3227701e8804 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:26.485750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de15900e-a5b2-4ccd-8944-2ec259a2420a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:26.486702 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de15900e-a5b2-4ccd-8944-2ec259a2420a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:26.487167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de15900e-a5b2-4ccd-8944-2ec259a2420a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:26.492590 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-704a589e-a0a5-4cb8-922f-3227701e8804 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:26.493033 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-704a589e-a0a5-4cb8-922f-3227701e8804 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:26.493789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-704a589e-a0a5-4cb8-922f-3227701e8804 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:26.494215 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-704a589e-a0a5-4cb8-922f-3227701e8804 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:26.784098 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-de15900e-a5b2-4ccd-8944-2ec259a2420a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:26.788938 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-704a589e-a0a5-4cb8-922f-3227701e8804 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:26.793836 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-de15900e-a5b2-4ccd-8944-2ec259a2420a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:26.795432 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-de15900e-a5b2-4ccd-8944-2ec259a2420a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:26.796639 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-de15900e-a5b2-4ccd-8944-2ec259a2420a tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.322562 Feb 28 19:10:26.797111 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-704a589e-a0a5-4cb8-922f-3227701e8804 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1671 microversion: 2.1 time: 0.316311 Feb 28 19:10:26.807178 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 375/759] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:26 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:26.807385 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 385/760] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:26 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1671 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:27.100767 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-48dc0a47-4440-4569-bf35-8864c3a97aa8 req-46bb3969-9ef6-40cb-ae8e-79bd6fe7ceaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629f35f4-df5f-4e49-a667-11c0cc7d7fed", "name": "network-vif-deleted", "tag": "570b9152-0452-4bdd-addb-cff2fd1756fd"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:10:27.102292 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:10:27.102292 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:10:27.110407 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-48dc0a47-4440-4569-bf35-8864c3a97aa8 req-46bb3969-9ef6-40cb-ae8e-79bd6fe7ceaf service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:27.110849 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-48dc0a47-4440-4569-bf35-8864c3a97aa8 req-46bb3969-9ef6-40cb-ae8e-79bd6fe7ceaf service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:27.128203 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-48dc0a47-4440-4569-bf35-8864c3a97aa8 req-46bb3969-9ef6-40cb-ae8e-79bd6fe7ceaf service nova] Creating event network-vif-deleted:570b9152-0452-4bdd-addb-cff2fd1756fd for instance 629f35f4-df5f-4e49-a667-11c0cc7d7fed on hv-cinder-83118 Feb 28 19:10:27.133341 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-48dc0a47-4440-4569-bf35-8864c3a97aa8 req-46bb3969-9ef6-40cb-ae8e-79bd6fe7ceaf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037041 Feb 28 19:10:27.133933 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 376/761] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:10:27.488920 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-dafe9909-242b-4506-adba-81f47f7c6d8b tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:27.489659 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-dafe9909-242b-4506-adba-81f47f7c6d8b tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:27.497154 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dafe9909-242b-4506-adba-81f47f7c6d8b tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:27.497601 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dafe9909-242b-4506-adba-81f47f7c6d8b tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:27.498365 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dafe9909-242b-4506-adba-81f47f7c6d8b tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:27.498792 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-dafe9909-242b-4506-adba-81f47f7c6d8b tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:27.616521 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-dafe9909-242b-4506-adba-81f47f7c6d8b tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:27.624958 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-dafe9909-242b-4506-adba-81f47f7c6d8b tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 200 len: 1225 microversion: 2.1 time: 0.139795 Feb 28 19:10:27.625841 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 386/762] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:27 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 1225 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:27.814375 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ebd29a4b-943a-4bda-af09-86bb4446447b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:27.815092 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ebd29a4b-943a-4bda-af09-86bb4446447b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:27.816273 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e9ba83c5-d0b5-413c-952e-f0d20c1e6e6d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:27.816970 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e9ba83c5-d0b5-413c-952e-f0d20c1e6e6d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:27.823841 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ebd29a4b-943a-4bda-af09-86bb4446447b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:27.824364 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ebd29a4b-943a-4bda-af09-86bb4446447b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:27.825217 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ebd29a4b-943a-4bda-af09-86bb4446447b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:27.825332 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e9ba83c5-d0b5-413c-952e-f0d20c1e6e6d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:27.825749 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ebd29a4b-943a-4bda-af09-86bb4446447b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:27.825915 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e9ba83c5-d0b5-413c-952e-f0d20c1e6e6d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:27.826760 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e9ba83c5-d0b5-413c-952e-f0d20c1e6e6d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:27.827298 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e9ba83c5-d0b5-413c-952e-f0d20c1e6e6d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:28.129060 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e9ba83c5-d0b5-413c-952e-f0d20c1e6e6d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:28.135943 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ebd29a4b-943a-4bda-af09-86bb4446447b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:28.139313 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e9ba83c5-d0b5-413c-952e-f0d20c1e6e6d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:28.142600 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e9ba83c5-d0b5-413c-952e-f0d20c1e6e6d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:28.142600 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e9ba83c5-d0b5-413c-952e-f0d20c1e6e6d tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.329825 Feb 28 19:10:28.145394 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ebd29a4b-943a-4bda-af09-86bb4446447b tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1671 microversion: 2.1 time: 0.335108 Feb 28 19:10:28.146066 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 377/763] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:27 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1671 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:28.151036 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 387/764] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:27 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:28.641681 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ecbc112a-177b-4a34-be38-e4cc060551fd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:28.642429 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ecbc112a-177b-4a34-be38-e4cc060551fd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:28.649691 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ecbc112a-177b-4a34-be38-e4cc060551fd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:28.650205 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ecbc112a-177b-4a34-be38-e4cc060551fd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:28.650977 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ecbc112a-177b-4a34-be38-e4cc060551fd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:28.651461 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ecbc112a-177b-4a34-be38-e4cc060551fd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:28.704311 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-ecbc112a-177b-4a34-be38-e4cc060551fd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] HTTP exception thrown: Instance 629f35f4-df5f-4e49-a667-11c0cc7d7fed could not be found. Feb 28 19:10:28.704929 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ecbc112a-177b-4a34-be38-e4cc060551fd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Returning 404 to user: Instance 629f35f4-df5f-4e49-a667-11c0cc7d7fed could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:10:28.705908 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ecbc112a-177b-4a34-be38-e4cc060551fd tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 404 len: 111 microversion: 2.1 time: 0.067956 Feb 28 19:10:28.706700 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 378/765] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:28 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:10:28.763655 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1126130537", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1298881284", "security_groups": [{"name": "tempest-secgroup-smoke-691725167"}], "block_device_mapping_v2": [{"uuid": "3e06d9d5-acd3-4fce-b685-2f933b9a729d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "782279ce-5700-40e2-9c75-fac7ff451ff3"}]}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:10:28.942779 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.network.neutron [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] validate_networks() for [('782279ce-5700-40e2-9c75-fac7ff451ff3', None, None, None)] {{(pid=101791) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:10:29.160363 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9c3a30d4-cdb4-42d3-a4aa-065daf9ad09f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:29.161025 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9c3a30d4-cdb4-42d3-a4aa-065daf9ad09f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:29.169788 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c3a30d4-cdb4-42d3-a4aa-065daf9ad09f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:29.170599 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c3a30d4-cdb4-42d3-a4aa-065daf9ad09f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:29.171477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c3a30d4-cdb4-42d3-a4aa-065daf9ad09f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:29.171980 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c3a30d4-cdb4-42d3-a4aa-065daf9ad09f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:29.691214 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9c3a30d4-cdb4-42d3-a4aa-065daf9ad09f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:29.703409 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9c3a30d4-cdb4-42d3-a4aa-065daf9ad09f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:29.705444 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9c3a30d4-cdb4-42d3-a4aa-065daf9ad09f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:29.707632 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9c3a30d4-cdb4-42d3-a4aa-065daf9ad09f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.551490 Feb 28 19:10:29.714481 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 379/766] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:29 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:29.719669 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-52d2f5c2-d85f-40ef-88e0-404d2105a15f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:29.720647 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-52d2f5c2-d85f-40ef-88e0-404d2105a15f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:29.722851 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Flavor limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:10:29.723312 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Image limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:10:29.724058 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Flavor pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:10:29.724805 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Image pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:10:29.725386 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:10:29.728843 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-52d2f5c2-d85f-40ef-88e0-404d2105a15f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:29.729324 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-52d2f5c2-d85f-40ef-88e0-404d2105a15f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:29.730058 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-52d2f5c2-d85f-40ef-88e0-404d2105a15f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:29.731171 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-52d2f5c2-d85f-40ef-88e0-404d2105a15f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:29.735385 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:29.736031 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:29.736994 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:29.737594 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:29.757174 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Getting quotas for project 90acc320256d4622a351a587d9f604c3. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:10:29.761686 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Getting quotas for user 59f038939b324d9b8e7214cec4e82933 and project 90acc320256d4622a351a587d9f604c3. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:10:29.860471 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-52d2f5c2-d85f-40ef-88e0-404d2105a15f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:29.862380 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Going to run 1 instances... {{(pid=101791) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:10:29.865082 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e06d9d5-acd3-4fce-b685-2f933b9a729d',volume_size=None,volume_type=None)] {{(pid=101791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:10:29.870273 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-52d2f5c2-d85f-40ef-88e0-404d2105a15f tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1604 microversion: 2.1 time: 0.153647 Feb 28 19:10:29.878545 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 380/767] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:29 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1604 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:29.904074 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-9c202a59-1562-4caf-92a5-152178dce032 req-55373ddc-a246-4e00-b09d-00078b7230bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aea8cac-d69e-4467-9c2e-d38652fbf89f", "name": "network-vif-plugged", "status": "completed", "tag": "29a481fd-7c99-42e1-92d5-26fb61661a7d"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:10:29.905738 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:10:29.905738 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:10:29.919907 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-9c202a59-1562-4caf-92a5-152178dce032 req-55373ddc-a246-4e00-b09d-00078b7230bc service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:29.920343 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-9c202a59-1562-4caf-92a5-152178dce032 req-55373ddc-a246-4e00-b09d-00078b7230bc service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:29.945097 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-9c202a59-1562-4caf-92a5-152178dce032 req-55373ddc-a246-4e00-b09d-00078b7230bc service nova] Creating event network-vif-plugged:29a481fd-7c99-42e1-92d5-26fb61661a7d for instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f on hv-cinder-83118 Feb 28 19:10:29.950582 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-9c202a59-1562-4caf-92a5-152178dce032 req-55373ddc-a246-4e00-b09d-00078b7230bc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051702 Feb 28 19:10:29.953331 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 381/768] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:10:30.132929 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-8156389e-5c74-41a7-83ba-d1ee12cae581 req-2d45d878-9293-4930-a54c-0f7ae1f0b2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970b2934-fe16-4039-9044-1e31b3217360", "name": "network-vif-deleted", "tag": "4c635eef-3e33-4a57-89ab-34702645a636"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:10:30.134582 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:10:30.134582 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:10:30.155382 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-8156389e-5c74-41a7-83ba-d1ee12cae581 req-2d45d878-9293-4930-a54c-0f7ae1f0b2b3 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:30.156079 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-8156389e-5c74-41a7-83ba-d1ee12cae581 req-2d45d878-9293-4930-a54c-0f7ae1f0b2b3 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:30.174481 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-8156389e-5c74-41a7-83ba-d1ee12cae581 req-2d45d878-9293-4930-a54c-0f7ae1f0b2b3 service nova] Creating event network-vif-deleted:4c635eef-3e33-4a57-89ab-34702645a636 for instance 970b2934-fe16-4039-9044-1e31b3217360 on hv-cinder-83118 Feb 28 19:10:30.181047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-8156389e-5c74-41a7-83ba-d1ee12cae581 req-2d45d878-9293-4930-a54c-0f7ae1f0b2b3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052898 Feb 28 19:10:30.182162 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 382/769] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:10:30.382382 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-fca89887-c51f-47d5-ac21-033a68251d1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.622416 Feb 28 19:10:30.389610 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 388/770] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:10:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:10:30.395435 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0037c948-8187-4b7e-a791-84c135a8054f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:30.396179 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0037c948-8187-4b7e-a791-84c135a8054f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:30.486346 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0037c948-8187-4b7e-a791-84c135a8054f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:30.494645 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0037c948-8187-4b7e-a791-84c135a8054f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1095 microversion: 2.1 time: 0.104366 Feb 28 19:10:30.495967 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 383/771] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:30 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:10:30.729476 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2a01daed-b853-4a72-a396-11ed07d464ec tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:30.730127 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-2a01daed-b853-4a72-a396-11ed07d464ec tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:30.738639 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a01daed-b853-4a72-a396-11ed07d464ec tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:30.739083 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a01daed-b853-4a72-a396-11ed07d464ec tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:30.740660 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a01daed-b853-4a72-a396-11ed07d464ec tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:30.741300 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a01daed-b853-4a72-a396-11ed07d464ec tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:30.887709 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-98184f45-b9f4-4e6d-a5ca-b00c54c9363c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:30.888621 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-98184f45-b9f4-4e6d-a5ca-b00c54c9363c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:30.903621 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-98184f45-b9f4-4e6d-a5ca-b00c54c9363c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:30.904373 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-98184f45-b9f4-4e6d-a5ca-b00c54c9363c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:30.905342 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-98184f45-b9f4-4e6d-a5ca-b00c54c9363c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:30.905928 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-98184f45-b9f4-4e6d-a5ca-b00c54c9363c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:30.960299 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-2a01daed-b853-4a72-a396-11ed07d464ec tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:30.974866 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-2a01daed-b853-4a72-a396-11ed07d464ec tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:30.976519 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-2a01daed-b853-4a72-a396-11ed07d464ec tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:30.977649 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2a01daed-b853-4a72-a396-11ed07d464ec tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.255674 Feb 28 19:10:30.978199 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 389/772] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:30 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:31.003085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-98184f45-b9f4-4e6d-a5ca-b00c54c9363c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:31.003559 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-98184f45-b9f4-4e6d-a5ca-b00c54c9363c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:31.004065 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-98184f45-b9f4-4e6d-a5ca-b00c54c9363c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lazy-loading 'fault' on Instance uuid 970b2934-fe16-4039-9044-1e31b3217360 {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:10:31.062337 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-98184f45-b9f4-4e6d-a5ca-b00c54c9363c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a958a47ae44558a637dbe34b5a8f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00c264516ff48bdb7d2411e37b27ff4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:31.070451 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-98184f45-b9f4-4e6d-a5ca-b00c54c9363c tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 200 len: 1326 microversion: 2.1 time: 0.186603 Feb 28 19:10:31.071020 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 384/773] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:30 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 1326 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:31.512357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e661c180-50ca-4e0a-be4f-afe7413863b6 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:31.512952 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e661c180-50ca-4e0a-be4f-afe7413863b6 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:31.520442 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e661c180-50ca-4e0a-be4f-afe7413863b6 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:31.521571 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e661c180-50ca-4e0a-be4f-afe7413863b6 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:31.522372 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e661c180-50ca-4e0a-be4f-afe7413863b6 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:31.522812 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e661c180-50ca-4e0a-be4f-afe7413863b6 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:31.643614 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e661c180-50ca-4e0a-be4f-afe7413863b6 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:31.653096 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e661c180-50ca-4e0a-be4f-afe7413863b6 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1145 microversion: 2.1 time: 0.144521 Feb 28 19:10:31.653865 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 390/774] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:31 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1145 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:31.995555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-3a434b8e-1209-49df-b91b-ed67ea5897c1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:31.996280 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3a434b8e-1209-49df-b91b-ed67ea5897c1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:32.003642 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3a434b8e-1209-49df-b91b-ed67ea5897c1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:32.004091 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3a434b8e-1209-49df-b91b-ed67ea5897c1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:32.004895 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3a434b8e-1209-49df-b91b-ed67ea5897c1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:32.005580 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3a434b8e-1209-49df-b91b-ed67ea5897c1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:32.088055 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-66449229-ffd1-4661-a41c-a9cda22efc08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:32.088631 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-66449229-ffd1-4661-a41c-a9cda22efc08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:32.095936 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-66449229-ffd1-4661-a41c-a9cda22efc08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:32.096385 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-66449229-ffd1-4661-a41c-a9cda22efc08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:32.097151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-66449229-ffd1-4661-a41c-a9cda22efc08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:32.097583 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-66449229-ffd1-4661-a41c-a9cda22efc08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:32.155408 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-66449229-ffd1-4661-a41c-a9cda22efc08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] HTTP exception thrown: Instance 970b2934-fe16-4039-9044-1e31b3217360 could not be found. Feb 28 19:10:32.156067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-66449229-ffd1-4661-a41c-a9cda22efc08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Returning 404 to user: Instance 970b2934-fe16-4039-9044-1e31b3217360 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:10:32.156915 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-66449229-ffd1-4661-a41c-a9cda22efc08 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 404 len: 111 microversion: 2.1 time: 0.073010 Feb 28 19:10:32.157728 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 391/775] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:32 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 19:10:32.166602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-60728ffa-2039-4276-8753-9bc1660ac957 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '.version_select at 0x7f912e56a9d0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:32.209179 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-3a434b8e-1209-49df-b91b-ed67ea5897c1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:32.218019 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-3a434b8e-1209-49df-b91b-ed67ea5897c1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:32.219547 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-3a434b8e-1209-49df-b91b-ed67ea5897c1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:32.220659 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-3a434b8e-1209-49df-b91b-ed67ea5897c1 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.228925 Feb 28 19:10:32.221212 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 385/776] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:31 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:32.254030 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-60728ffa-2039-4276-8753-9bc1660ac957 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237206392" status: 202 len: 0 microversion: 2.1 time: 0.090829 Feb 28 19:10:32.254602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 392/777] 10.222.0.21 () {58 vars in 1217 bytes} [Mon Feb 28 19:10:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237206392 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 28 19:10:32.670231 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-327362ec-6384-4bf7-9625-6c15441542e9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:32.675657 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-327362ec-6384-4bf7-9625-6c15441542e9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:32.678829 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-327362ec-6384-4bf7-9625-6c15441542e9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:32.679603 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-327362ec-6384-4bf7-9625-6c15441542e9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:32.680559 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-327362ec-6384-4bf7-9625-6c15441542e9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:32.681155 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-327362ec-6384-4bf7-9625-6c15441542e9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:32.898761 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-327362ec-6384-4bf7-9625-6c15441542e9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:32.924694 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-327362ec-6384-4bf7-9625-6c15441542e9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1201 microversion: 2.1 time: 0.257947 Feb 28 19:10:32.925744 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 386/778] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:32 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1201 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:33.240360 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-086a0528-d5ec-4ffc-8605-7b8ca6d5f3a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:33.241139 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-086a0528-d5ec-4ffc-8605-7b8ca6d5f3a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:33.248140 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-086a0528-d5ec-4ffc-8605-7b8ca6d5f3a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:33.248826 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-086a0528-d5ec-4ffc-8605-7b8ca6d5f3a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:33.249600 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-086a0528-d5ec-4ffc-8605-7b8ca6d5f3a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:33.250098 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-086a0528-d5ec-4ffc-8605-7b8ca6d5f3a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:33.731549 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-086a0528-d5ec-4ffc-8605-7b8ca6d5f3a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:33.749527 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-086a0528-d5ec-4ffc-8605-7b8ca6d5f3a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:33.751523 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-086a0528-d5ec-4ffc-8605-7b8ca6d5f3a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:33.753156 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-086a0528-d5ec-4ffc-8605-7b8ca6d5f3a4 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1732 microversion: 2.20 time: 0.517313 Feb 28 19:10:33.754059 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 393/779] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:33 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1732 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 28 19:10:33.942220 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8d9c691c-ba54-444b-9a21-66508d41c443 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:33.943669 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8d9c691c-ba54-444b-9a21-66508d41c443 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:33.951095 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d9c691c-ba54-444b-9a21-66508d41c443 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:33.951570 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d9c691c-ba54-444b-9a21-66508d41c443 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:33.952335 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d9c691c-ba54-444b-9a21-66508d41c443 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:33.952770 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d9c691c-ba54-444b-9a21-66508d41c443 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:34.165898 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8d9c691c-ba54-444b-9a21-66508d41c443 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:34.186266 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8d9c691c-ba54-444b-9a21-66508d41c443 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1278 microversion: 2.1 time: 0.247535 Feb 28 19:10:34.187581 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 387/780] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:33 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1278 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:34.772508 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-eeca5ce1-870e-4ca7-827b-3004656a13a3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:34.773221 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-eeca5ce1-870e-4ca7-827b-3004656a13a3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:34.780506 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eeca5ce1-870e-4ca7-827b-3004656a13a3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:34.780965 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eeca5ce1-870e-4ca7-827b-3004656a13a3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:34.781815 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eeca5ce1-870e-4ca7-827b-3004656a13a3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:34.782570 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eeca5ce1-870e-4ca7-827b-3004656a13a3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:34.952176 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-5d76495b-6247-4bac-9eb0-fc49c17c2a6a req-ce3a6c13-a7ad-468d-8b46-486e895c345d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd6925a-7700-4ae1-8032-cf7bd2513f3b", "tag": "a42c7f1f-fdd6-4089-ba61-437e667d8528"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:10:34.952176 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:10:34.952176 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:10:34.965597 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-5d76495b-6247-4bac-9eb0-fc49c17c2a6a req-ce3a6c13-a7ad-468d-8b46-486e895c345d service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:34.966237 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-5d76495b-6247-4bac-9eb0-fc49c17c2a6a req-ce3a6c13-a7ad-468d-8b46-486e895c345d service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:34.989020 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-5d76495b-6247-4bac-9eb0-fc49c17c2a6a req-ce3a6c13-a7ad-468d-8b46-486e895c345d service nova] Creating event network-changed:a42c7f1f-fdd6-4089-ba61-437e667d8528 for instance dfd6925a-7700-4ae1-8032-cf7bd2513f3b on hv-cinder-83118 Feb 28 19:10:34.992622 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-eeca5ce1-870e-4ca7-827b-3004656a13a3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:34.995566 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-5d76495b-6247-4bac-9eb0-fc49c17c2a6a req-ce3a6c13-a7ad-468d-8b46-486e895c345d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056254 Feb 28 19:10:34.996705 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 388/781] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:10:35.005663 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-eeca5ce1-870e-4ca7-827b-3004656a13a3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:35.008244 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-eeca5ce1-870e-4ca7-827b-3004656a13a3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:35.009514 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-eeca5ce1-870e-4ca7-827b-3004656a13a3 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1719 microversion: 2.20 time: 0.240925 Feb 28 19:10:35.010058 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 394/782] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:10:34 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1719 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:10:35.210387 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-bf30bd26-36c6-49e1-8998-9a2ccf335ad9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:35.211013 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-bf30bd26-36c6-49e1-8998-9a2ccf335ad9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:35.218347 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf30bd26-36c6-49e1-8998-9a2ccf335ad9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:35.218987 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf30bd26-36c6-49e1-8998-9a2ccf335ad9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:35.219993 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf30bd26-36c6-49e1-8998-9a2ccf335ad9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:35.220438 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bf30bd26-36c6-49e1-8998-9a2ccf335ad9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:35.421286 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-bf30bd26-36c6-49e1-8998-9a2ccf335ad9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:35.430532 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-bf30bd26-36c6-49e1-8998-9a2ccf335ad9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.224820 Feb 28 19:10:35.431153 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 389/783] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:35 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:36.447499 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b24de359-a4e2-4db9-8f35-e61f38f75b0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:36.448104 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b24de359-a4e2-4db9-8f35-e61f38f75b0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:36.455204 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b24de359-a4e2-4db9-8f35-e61f38f75b0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:36.455645 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b24de359-a4e2-4db9-8f35-e61f38f75b0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:36.456401 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b24de359-a4e2-4db9-8f35-e61f38f75b0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:36.456827 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b24de359-a4e2-4db9-8f35-e61f38f75b0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:36.633061 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4db53440-6e32-4587-8e34-6149c6d9ed33 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:36.633757 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4db53440-6e32-4587-8e34-6149c6d9ed33 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:36.641202 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4db53440-6e32-4587-8e34-6149c6d9ed33 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:36.641656 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4db53440-6e32-4587-8e34-6149c6d9ed33 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:36.642427 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4db53440-6e32-4587-8e34-6149c6d9ed33 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:36.642867 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4db53440-6e32-4587-8e34-6149c6d9ed33 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:36.656493 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b24de359-a4e2-4db9-8f35-e61f38f75b0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:36.665423 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b24de359-a4e2-4db9-8f35-e61f38f75b0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.221746 Feb 28 19:10:36.665975 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 395/784] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:36 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:10:36.694399 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-4db53440-6e32-4587-8e34-6149c6d9ed33 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] HTTP exception thrown: Instance 970b2934-fe16-4039-9044-1e31b3217360 could not be found. Feb 28 19:10:36.695009 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4db53440-6e32-4587-8e34-6149c6d9ed33 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Returning 404 to user: Instance 970b2934-fe16-4039-9044-1e31b3217360 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:10:36.695865 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4db53440-6e32-4587-8e34-6149c6d9ed33 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "DELETE /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 404 len: 111 microversion: 2.1 time: 0.067179 Feb 28 19:10:36.696414 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 390/785] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:10:36 2022] DELETE /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 28 19:10:36.703968 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6359a461-fc21-49ac-937d-c737ca1fec20 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:36.704711 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-6359a461-fc21-49ac-937d-c737ca1fec20 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 970b2934-fe16-4039-9044-1e31b3217360] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:36.712373 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6359a461-fc21-49ac-937d-c737ca1fec20 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:36.712809 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6359a461-fc21-49ac-937d-c737ca1fec20 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:36.713562 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6359a461-fc21-49ac-937d-c737ca1fec20 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:36.713983 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6359a461-fc21-49ac-937d-c737ca1fec20 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:36.762887 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-6359a461-fc21-49ac-937d-c737ca1fec20 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] HTTP exception thrown: Instance 970b2934-fe16-4039-9044-1e31b3217360 could not be found. Feb 28 19:10:36.763495 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6359a461-fc21-49ac-937d-c737ca1fec20 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Returning 404 to user: Instance 970b2934-fe16-4039-9044-1e31b3217360 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:10:36.764290 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6359a461-fc21-49ac-937d-c737ca1fec20 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360" status: 404 len: 111 microversion: 2.1 time: 0.063957 Feb 28 19:10:36.764812 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 396/786] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:36 2022] GET /compute/v2.1/servers/970b2934-fe16-4039-9044-1e31b3217360 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:10:37.682165 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-fcc8016a-aaf1-4deb-abc4-47c2457496ac tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:37.682773 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-fcc8016a-aaf1-4deb-abc4-47c2457496ac tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:37.690827 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fcc8016a-aaf1-4deb-abc4-47c2457496ac tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:37.691317 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fcc8016a-aaf1-4deb-abc4-47c2457496ac tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:37.692096 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fcc8016a-aaf1-4deb-abc4-47c2457496ac tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:37.692667 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-fcc8016a-aaf1-4deb-abc4-47c2457496ac tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:37.892680 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-fcc8016a-aaf1-4deb-abc4-47c2457496ac tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:37.901535 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-fcc8016a-aaf1-4deb-abc4-47c2457496ac tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.223041 Feb 28 19:10:37.902287 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 391/787] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:37 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:38.096997 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b14eba5b-6cff-4592-8420-a5064cc66cd6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:38.097489 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b14eba5b-6cff-4592-8420-a5064cc66cd6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:38.105597 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b14eba5b-6cff-4592-8420-a5064cc66cd6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:38.106042 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b14eba5b-6cff-4592-8420-a5064cc66cd6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:38.106818 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b14eba5b-6cff-4592-8420-a5064cc66cd6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:38.107282 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b14eba5b-6cff-4592-8420-a5064cc66cd6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:38.166952 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-b14eba5b-6cff-4592-8420-a5064cc66cd6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] HTTP exception thrown: Instance 45883a52-0422-4de3-b428-d6f24780b283 could not be found. Feb 28 19:10:38.167551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b14eba5b-6cff-4592-8420-a5064cc66cd6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Returning 404 to user: Instance 45883a52-0422-4de3-b428-d6f24780b283 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:10:38.168381 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b14eba5b-6cff-4592-8420-a5064cc66cd6 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "DELETE /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 404 len: 111 microversion: 2.1 time: 0.075234 Feb 28 19:10:38.168945 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 397/788] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:10:38 2022] DELETE /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:10:38.177147 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9c56fa50-c349-44c6-b914-347635dd3996 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:38.177786 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9c56fa50-c349-44c6-b914-347635dd3996 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] [instance: 45883a52-0422-4de3-b428-d6f24780b283] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:38.185738 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c56fa50-c349-44c6-b914-347635dd3996 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:38.186383 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c56fa50-c349-44c6-b914-347635dd3996 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:38.187472 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c56fa50-c349-44c6-b914-347635dd3996 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:38.188114 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c56fa50-c349-44c6-b914-347635dd3996 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:38.244070 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-9c56fa50-c349-44c6-b914-347635dd3996 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] HTTP exception thrown: Instance 45883a52-0422-4de3-b428-d6f24780b283 could not be found. Feb 28 19:10:38.244716 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9c56fa50-c349-44c6-b914-347635dd3996 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] Returning 404 to user: Instance 45883a52-0422-4de3-b428-d6f24780b283 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:10:38.245555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9c56fa50-c349-44c6-b914-347635dd3996 tempest-AttachVolumeTestJSON-16785520 tempest-AttachVolumeTestJSON-16785520-project] 10.222.0.21 "GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283" status: 404 len: 111 microversion: 2.1 time: 0.072354 Feb 28 19:10:38.246358 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 392/789] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:38 2022] GET /compute/v2.1/servers/45883a52-0422-4de3-b428-d6f24780b283 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:10:38.917822 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9d3292cd-702b-47ca-85a9-c1a976e7580d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:38.918437 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9d3292cd-702b-47ca-85a9-c1a976e7580d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:38.925812 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9d3292cd-702b-47ca-85a9-c1a976e7580d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:38.926377 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9d3292cd-702b-47ca-85a9-c1a976e7580d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:38.928322 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9d3292cd-702b-47ca-85a9-c1a976e7580d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:38.928768 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9d3292cd-702b-47ca-85a9-c1a976e7580d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:39.376537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9d3292cd-702b-47ca-85a9-c1a976e7580d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:39.385925 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9d3292cd-702b-47ca-85a9-c1a976e7580d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.471746 Feb 28 19:10:39.386486 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 398/790] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:38 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:40.402074 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ebd97fc1-33eb-4b76-9ad3-07da904f5575 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:40.402788 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ebd97fc1-33eb-4b76-9ad3-07da904f5575 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:40.410298 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ebd97fc1-33eb-4b76-9ad3-07da904f5575 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:40.410739 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ebd97fc1-33eb-4b76-9ad3-07da904f5575 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:40.412147 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ebd97fc1-33eb-4b76-9ad3-07da904f5575 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:40.412585 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ebd97fc1-33eb-4b76-9ad3-07da904f5575 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:40.917464 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ebd97fc1-33eb-4b76-9ad3-07da904f5575 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:40.925486 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ebd97fc1-33eb-4b76-9ad3-07da904f5575 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.527189 Feb 28 19:10:40.926912 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 393/791] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:40 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:41.942868 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c77cafb4-b893-4fdb-8eff-fe803d5d040f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:41.944340 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c77cafb4-b893-4fdb-8eff-fe803d5d040f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:41.952091 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c77cafb4-b893-4fdb-8eff-fe803d5d040f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:41.952856 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c77cafb4-b893-4fdb-8eff-fe803d5d040f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:41.953878 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c77cafb4-b893-4fdb-8eff-fe803d5d040f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:41.954545 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c77cafb4-b893-4fdb-8eff-fe803d5d040f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:42.337197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c77cafb4-b893-4fdb-8eff-fe803d5d040f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:42.345585 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c77cafb4-b893-4fdb-8eff-fe803d5d040f tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.406999 Feb 28 19:10:42.346160 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 399/792] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:41 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:43.363551 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0196c47c-011a-4f54-a519-bb666356f7a2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:43.364971 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0196c47c-011a-4f54-a519-bb666356f7a2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:43.372882 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0196c47c-011a-4f54-a519-bb666356f7a2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:43.373460 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0196c47c-011a-4f54-a519-bb666356f7a2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:43.374336 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0196c47c-011a-4f54-a519-bb666356f7a2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:43.374970 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0196c47c-011a-4f54-a519-bb666356f7a2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:43.968705 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0196c47c-011a-4f54-a519-bb666356f7a2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:43.980486 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0196c47c-011a-4f54-a519-bb666356f7a2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.620715 Feb 28 19:10:43.988590 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 394/793] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:43 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:44.997448 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ebe5c27f-66b5-4431-8811-ea83f072e476 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:44.998150 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ebe5c27f-66b5-4431-8811-ea83f072e476 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:45.006681 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebe5c27f-66b5-4431-8811-ea83f072e476 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:45.007148 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebe5c27f-66b5-4431-8811-ea83f072e476 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:45.007933 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebe5c27f-66b5-4431-8811-ea83f072e476 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:45.008395 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ebe5c27f-66b5-4431-8811-ea83f072e476 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:45.227494 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ebe5c27f-66b5-4431-8811-ea83f072e476 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:45.236203 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ebe5c27f-66b5-4431-8811-ea83f072e476 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.242485 Feb 28 19:10:45.236702 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 400/794] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:44 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:46.254747 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-16f353b5-7da5-4f58-af53-08c6c95e2a14 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:46.255295 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-16f353b5-7da5-4f58-af53-08c6c95e2a14 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:46.262965 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-16f353b5-7da5-4f58-af53-08c6c95e2a14 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:46.263449 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-16f353b5-7da5-4f58-af53-08c6c95e2a14 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:46.264231 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-16f353b5-7da5-4f58-af53-08c6c95e2a14 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:46.264667 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-16f353b5-7da5-4f58-af53-08c6c95e2a14 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:46.466720 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-16f353b5-7da5-4f58-af53-08c6c95e2a14 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:46.475555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-16f353b5-7da5-4f58-af53-08c6c95e2a14 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.226510 Feb 28 19:10:46.476330 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 395/795] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:46 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:47.492734 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-94b444f8-1427-42b9-8496-dcb6d3d16b1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:47.493263 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-94b444f8-1427-42b9-8496-dcb6d3d16b1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:47.500638 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-94b444f8-1427-42b9-8496-dcb6d3d16b1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:47.501079 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-94b444f8-1427-42b9-8496-dcb6d3d16b1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:47.501850 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-94b444f8-1427-42b9-8496-dcb6d3d16b1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:47.502271 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-94b444f8-1427-42b9-8496-dcb6d3d16b1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:47.697551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-94b444f8-1427-42b9-8496-dcb6d3d16b1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:47.705802 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-94b444f8-1427-42b9-8496-dcb6d3d16b1a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.217452 Feb 28 19:10:47.706594 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 401/796] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:47 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:47.986212 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-d251c0b1-675f-4d46-8acf-386c7c0139df req-16a6860f-87d8-484a-ae85-ff94973f9ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd6925a-7700-4ae1-8032-cf7bd2513f3b", "name": "network-vif-plugged", "status": "completed", "tag": "a42c7f1f-fdd6-4089-ba61-437e667d8528"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:10:47.987788 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:10:47.987788 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:10:47.996695 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-d251c0b1-675f-4d46-8acf-386c7c0139df req-16a6860f-87d8-484a-ae85-ff94973f9ed6 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:47.997140 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-d251c0b1-675f-4d46-8acf-386c7c0139df req-16a6860f-87d8-484a-ae85-ff94973f9ed6 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:48.013518 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-d251c0b1-675f-4d46-8acf-386c7c0139df req-16a6860f-87d8-484a-ae85-ff94973f9ed6 service nova] Creating event network-vif-plugged:a42c7f1f-fdd6-4089-ba61-437e667d8528 for instance dfd6925a-7700-4ae1-8032-cf7bd2513f3b on hv-cinder-83118 Feb 28 19:10:48.018301 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-d251c0b1-675f-4d46-8acf-386c7c0139df req-16a6860f-87d8-484a-ae85-ff94973f9ed6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037204 Feb 28 19:10:48.021117 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 396/797] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:10:48.722934 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a884b4c7-1b43-4f45-a559-6bb658201c70 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:48.724143 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a884b4c7-1b43-4f45-a559-6bb658201c70 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:48.731640 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a884b4c7-1b43-4f45-a559-6bb658201c70 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:48.732092 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a884b4c7-1b43-4f45-a559-6bb658201c70 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:48.732866 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a884b4c7-1b43-4f45-a559-6bb658201c70 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:48.733306 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a884b4c7-1b43-4f45-a559-6bb658201c70 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:48.931585 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a884b4c7-1b43-4f45-a559-6bb658201c70 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:48.940147 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a884b4c7-1b43-4f45-a559-6bb658201c70 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.220950 Feb 28 19:10:48.940748 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 402/798] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:48 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:49.959509 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-bce46f3c-2c4b-42bd-b079-3eca40bd9f42 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:49.960814 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-bce46f3c-2c4b-42bd-b079-3eca40bd9f42 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:49.969088 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bce46f3c-2c4b-42bd-b079-3eca40bd9f42 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:49.969534 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bce46f3c-2c4b-42bd-b079-3eca40bd9f42 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:49.970527 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bce46f3c-2c4b-42bd-b079-3eca40bd9f42 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:49.970957 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bce46f3c-2c4b-42bd-b079-3eca40bd9f42 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:50.178326 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-bce46f3c-2c4b-42bd-b079-3eca40bd9f42 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:50.187292 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-bce46f3c-2c4b-42bd-b079-3eca40bd9f42 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1266 microversion: 2.1 time: 0.232962 Feb 28 19:10:50.191919 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 397/799] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:49 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:10:51.204323 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8b8cccf7-d4da-45e7-817c-67bf4c25f83d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:51.204929 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8b8cccf7-d4da-45e7-817c-67bf4c25f83d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:51.212460 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b8cccf7-d4da-45e7-817c-67bf4c25f83d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:51.212908 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b8cccf7-d4da-45e7-817c-67bf4c25f83d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:51.213668 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b8cccf7-d4da-45e7-817c-67bf4c25f83d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:51.214100 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8b8cccf7-d4da-45e7-817c-67bf4c25f83d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:51.409346 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8b8cccf7-d4da-45e7-817c-67bf4c25f83d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:51.418104 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8b8cccf7-d4da-45e7-817c-67bf4c25f83d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1453 microversion: 2.1 time: 0.217484 Feb 28 19:10:51.418661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 403/800] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:51 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1453 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:51.433622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f6f5c220-fa7a-4c28-95bb-79e55fdd062c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:10:51.434234 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f6f5c220-fa7a-4c28-95bb-79e55fdd062c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:10:51.441450 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f6f5c220-fa7a-4c28-95bb-79e55fdd062c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:51.441897 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f6f5c220-fa7a-4c28-95bb-79e55fdd062c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:51.442846 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f6f5c220-fa7a-4c28-95bb-79e55fdd062c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:51.443340 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f6f5c220-fa7a-4c28-95bb-79e55fdd062c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:51.636847 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f6f5c220-fa7a-4c28-95bb-79e55fdd062c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:10:51.644913 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f6f5c220-fa7a-4c28-95bb-79e55fdd062c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1453 microversion: 2.1 time: 0.214986 Feb 28 19:10:51.646088 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 398/801] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:10:51 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:10:54.396212 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-2c779369-719e-4853-b235-6aed4de01288 req-3e1ab681-ced1-4c0e-ab74-1b68b1764dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd6925a-7700-4ae1-8032-cf7bd2513f3b", "tag": "a42c7f1f-fdd6-4089-ba61-437e667d8528"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:10:54.399234 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:10:54.399234 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:10:54.411578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-2c779369-719e-4853-b235-6aed4de01288 req-3e1ab681-ced1-4c0e-ab74-1b68b1764dad service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:10:54.412055 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-2c779369-719e-4853-b235-6aed4de01288 req-3e1ab681-ced1-4c0e-ab74-1b68b1764dad service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:10:54.428967 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-2c779369-719e-4853-b235-6aed4de01288 req-3e1ab681-ced1-4c0e-ab74-1b68b1764dad service nova] Creating event network-changed:a42c7f1f-fdd6-4089-ba61-437e667d8528 for instance dfd6925a-7700-4ae1-8032-cf7bd2513f3b on hv-cinder-83118 Feb 28 19:10:54.433820 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-2c779369-719e-4853-b235-6aed4de01288 req-3e1ab681-ced1-4c0e-ab74-1b68b1764dad service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042177 Feb 28 19:10:54.434449 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 404/802] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:11:42.636282 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:11:42.636802 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: Mon Feb 28 19:11:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:11:54.994275 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-21198092-7818-46fd-9717-b2a08f82cad6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:11:54.995340 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-21198092-7818-46fd-9717-b2a08f82cad6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:11:55.002645 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-21198092-7818-46fd-9717-b2a08f82cad6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:55.003091 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-21198092-7818-46fd-9717-b2a08f82cad6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:55.003884 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-21198092-7818-46fd-9717-b2a08f82cad6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:55.004377 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-21198092-7818-46fd-9717-b2a08f82cad6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:55.076088 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-21198092-7818-46fd-9717-b2a08f82cad6 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.086072 Feb 28 19:11:55.076847 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 399/803] 10.222.0.21 () {60 vars in 1342 bytes} [Mon Feb 28 19:11:54 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:11:55.167641 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-80c38d1b-9c43-48f5-8787-fed2a41a55bc tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:11:55.168233 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-80c38d1b-9c43-48f5-8787-fed2a41a55bc tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:11:55.175696 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-80c38d1b-9c43-48f5-8787-fed2a41a55bc tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:55.176148 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-80c38d1b-9c43-48f5-8787-fed2a41a55bc tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:55.176917 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-80c38d1b-9c43-48f5-8787-fed2a41a55bc tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:55.177353 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-80c38d1b-9c43-48f5-8787-fed2a41a55bc tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:55.236427 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-80c38d1b-9c43-48f5-8787-fed2a41a55bc tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Going to try to terminate instance {{(pid=101791) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:11:55.591841 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-80c38d1b-9c43-48f5-8787-fed2a41a55bc tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 204 len: 0 microversion: 2.20 time: 0.428711 Feb 28 19:11:55.592367 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 405/804] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Feb 28 19:11:55 2022] DELETE /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 28 19:11:55.600577 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-19dd703b-95aa-4b4f-b0a0-292a08868987 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:11:55.601275 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-19dd703b-95aa-4b4f-b0a0-292a08868987 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:11:55.610567 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-19dd703b-95aa-4b4f-b0a0-292a08868987 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:55.611019 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-19dd703b-95aa-4b4f-b0a0-292a08868987 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:55.611809 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-19dd703b-95aa-4b4f-b0a0-292a08868987 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:55.612421 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-19dd703b-95aa-4b4f-b0a0-292a08868987 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:55.976692 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-19dd703b-95aa-4b4f-b0a0-292a08868987 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:55.987488 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-19dd703b-95aa-4b4f-b0a0-292a08868987 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:55.988973 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-19dd703b-95aa-4b4f-b0a0-292a08868987 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:55.990107 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-19dd703b-95aa-4b4f-b0a0-292a08868987 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.393497 Feb 28 19:11:55.990663 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 400/805] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:11:55 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:11:57.010427 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-aba4ffb0-cbba-4528-94ca-e988877e6864 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:11:57.011141 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-aba4ffb0-cbba-4528-94ca-e988877e6864 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:11:57.018316 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-aba4ffb0-cbba-4528-94ca-e988877e6864 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:57.018754 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-aba4ffb0-cbba-4528-94ca-e988877e6864 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:57.019555 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-aba4ffb0-cbba-4528-94ca-e988877e6864 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:57.019987 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-aba4ffb0-cbba-4528-94ca-e988877e6864 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:57.266146 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-aba4ffb0-cbba-4528-94ca-e988877e6864 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:57.275523 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-aba4ffb0-cbba-4528-94ca-e988877e6864 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:57.277083 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-aba4ffb0-cbba-4528-94ca-e988877e6864 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:57.278193 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-aba4ffb0-cbba-4528-94ca-e988877e6864 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.271996 Feb 28 19:11:57.278744 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 406/806] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:11:57 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:11:58.295985 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-466b1376-c7e1-4430-b3ae-12b4c7596d64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:11:58.296586 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-466b1376-c7e1-4430-b3ae-12b4c7596d64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:11:58.305167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-466b1376-c7e1-4430-b3ae-12b4c7596d64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:58.306221 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-466b1376-c7e1-4430-b3ae-12b4c7596d64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:58.306999 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-466b1376-c7e1-4430-b3ae-12b4c7596d64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:58.307443 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-466b1376-c7e1-4430-b3ae-12b4c7596d64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:58.513918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-466b1376-c7e1-4430-b3ae-12b4c7596d64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:58.523196 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-466b1376-c7e1-4430-b3ae-12b4c7596d64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:58.525152 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-466b1376-c7e1-4430-b3ae-12b4c7596d64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:58.529145 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-466b1376-c7e1-4430-b3ae-12b4c7596d64 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1725 microversion: 2.20 time: 0.234070 Feb 28 19:11:58.529145 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 401/807] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:11:58 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:11:59.023738 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-f303e262-5ee5-4575-a56d-732f4864fcb7 req-b0084522-87d2-42a7-8637-ff7a5c295172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aea8cac-d69e-4467-9c2e-d38652fbf89f", "name": "network-vif-deleted", "tag": "29a481fd-7c99-42e1-92d5-26fb61661a7d"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:11:59.027266 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:11:59.027266 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:11:59.036921 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-f303e262-5ee5-4575-a56d-732f4864fcb7 req-b0084522-87d2-42a7-8637-ff7a5c295172 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:59.038195 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-f303e262-5ee5-4575-a56d-732f4864fcb7 req-b0084522-87d2-42a7-8637-ff7a5c295172 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:59.059686 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-f303e262-5ee5-4575-a56d-732f4864fcb7 req-b0084522-87d2-42a7-8637-ff7a5c295172 service nova] Creating event network-vif-deleted:29a481fd-7c99-42e1-92d5-26fb61661a7d for instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f on hv-cinder-83118 Feb 28 19:11:59.064877 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-f303e262-5ee5-4575-a56d-732f4864fcb7 req-b0084522-87d2-42a7-8637-ff7a5c295172 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045731 Feb 28 19:11:59.065473 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 407/808] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:11:59.545212 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-dbede7bb-aa84-4a95-ba0c-0b89524d519f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:11:59.545825 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-dbede7bb-aa84-4a95-ba0c-0b89524d519f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:11:59.552965 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbede7bb-aa84-4a95-ba0c-0b89524d519f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:59.553420 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbede7bb-aa84-4a95-ba0c-0b89524d519f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:59.554193 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbede7bb-aa84-4a95-ba0c-0b89524d519f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:11:59.554629 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbede7bb-aa84-4a95-ba0c-0b89524d519f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:11:59.674062 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dbede7bb-aa84-4a95-ba0c-0b89524d519f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:59.682946 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dbede7bb-aa84-4a95-ba0c-0b89524d519f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:59.684582 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dbede7bb-aa84-4a95-ba0c-0b89524d519f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:11:59.685776 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-dbede7bb-aa84-4a95-ba0c-0b89524d519f tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1657 microversion: 2.20 time: 0.144341 Feb 28 19:11:59.686396 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 402/809] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:11:59 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1657 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:12:00.704718 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6a5cc1d7-56ec-40b5-b58e-7f18bfa11c01 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:12:00.705412 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-6a5cc1d7-56ec-40b5-b58e-7f18bfa11c01 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:12:00.712918 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6a5cc1d7-56ec-40b5-b58e-7f18bfa11c01 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:00.713357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6a5cc1d7-56ec-40b5-b58e-7f18bfa11c01 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:00.714115 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6a5cc1d7-56ec-40b5-b58e-7f18bfa11c01 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:00.714544 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6a5cc1d7-56ec-40b5-b58e-7f18bfa11c01 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:00.825252 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6a5cc1d7-56ec-40b5-b58e-7f18bfa11c01 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:12:00.834103 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6a5cc1d7-56ec-40b5-b58e-7f18bfa11c01 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:12:00.835646 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6a5cc1d7-56ec-40b5-b58e-7f18bfa11c01 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9371804d1f943a6b6b3b2a9901030c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73fa98b1d974ed1935c4d3e2879abad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:12:00.836750 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6a5cc1d7-56ec-40b5-b58e-7f18bfa11c01 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 200 len: 1366 microversion: 2.20 time: 0.136247 Feb 28 19:12:00.837391 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 408/810] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:12:00 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 28 19:12:01.854879 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-301bff69-5df5-4b6c-815b-b593d74ca786 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:12:01.855505 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-301bff69-5df5-4b6c-815b-b593d74ca786 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:12:01.862768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-301bff69-5df5-4b6c-815b-b593d74ca786 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:01.863250 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-301bff69-5df5-4b6c-815b-b593d74ca786 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:01.864019 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-301bff69-5df5-4b6c-815b-b593d74ca786 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:01.864451 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-301bff69-5df5-4b6c-815b-b593d74ca786 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:01.916377 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-301bff69-5df5-4b6c-815b-b593d74ca786 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] HTTP exception thrown: Instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f could not be found. Feb 28 19:12:01.916994 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-301bff69-5df5-4b6c-815b-b593d74ca786 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Returning 404 to user: Instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:12:01.917829 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-301bff69-5df5-4b6c-815b-b593d74ca786 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 404 len: 111 microversion: 2.20 time: 0.066932 Feb 28 19:12:01.918387 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 403/811] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:12:01 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 28 19:12:01.926575 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e60197c1-75de-492d-b27b-ae3b8f48e00e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '.version_select at 0x7f912f6dd670>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:12:02.074221 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e60197c1-75de-492d-b27b-ae3b8f48e00e tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174504884" status: 204 len: 0 microversion: 2.20 time: 0.151153 Feb 28 19:12:02.074819 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 409/812] 10.222.0.21 () {60 vars in 1261 bytes} [Mon Feb 28 19:12:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174504884 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 28 19:12:07.138886 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9c838bcb-8af2-4921-ae11-3387eaf881fb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:12:07.139414 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9c838bcb-8af2-4921-ae11-3387eaf881fb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:12:07.146697 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c838bcb-8af2-4921-ae11-3387eaf881fb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:07.147176 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c838bcb-8af2-4921-ae11-3387eaf881fb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:07.153235 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c838bcb-8af2-4921-ae11-3387eaf881fb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:07.153235 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9c838bcb-8af2-4921-ae11-3387eaf881fb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:07.196944 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-9c838bcb-8af2-4921-ae11-3387eaf881fb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] HTTP exception thrown: Instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f could not be found. Feb 28 19:12:07.197546 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9c838bcb-8af2-4921-ae11-3387eaf881fb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Returning 404 to user: Instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:12:07.199042 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9c838bcb-8af2-4921-ae11-3387eaf881fb tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 404 len: 111 microversion: 2.20 time: 0.064475 Feb 28 19:12:07.199671 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 404/813] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Feb 28 19:12:07 2022] DELETE /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 28 19:12:07.207678 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-05082d7e-ee3d-47de-aa34-4564d3322226 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:12:07.208287 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-05082d7e-ee3d-47de-aa34-4564d3322226 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 1aea8cac-d69e-4467-9c2e-d38652fbf89f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:12:07.215633 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-05082d7e-ee3d-47de-aa34-4564d3322226 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:07.216076 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-05082d7e-ee3d-47de-aa34-4564d3322226 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:07.216839 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-05082d7e-ee3d-47de-aa34-4564d3322226 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:07.217273 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-05082d7e-ee3d-47de-aa34-4564d3322226 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:07.268963 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-05082d7e-ee3d-47de-aa34-4564d3322226 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] HTTP exception thrown: Instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f could not be found. Feb 28 19:12:07.269478 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-05082d7e-ee3d-47de-aa34-4564d3322226 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Returning 404 to user: Instance 1aea8cac-d69e-4467-9c2e-d38652fbf89f could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:12:07.270292 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-05082d7e-ee3d-47de-aa34-4564d3322226 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f" status: 404 len: 111 microversion: 2.20 time: 0.066474 Feb 28 19:12:07.270844 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 410/814] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:12:07 2022] GET /compute/v2.1/servers/1aea8cac-d69e-4467-9c2e-d38652fbf89f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 28 19:12:08.656230 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cb326762-b209-4c7e-9ba0-a143ad279bee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:12:08.656706 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-cb326762-b209-4c7e-9ba0-a143ad279bee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:12:08.663977 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cb326762-b209-4c7e-9ba0-a143ad279bee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:08.664425 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cb326762-b209-4c7e-9ba0-a143ad279bee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:08.665191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cb326762-b209-4c7e-9ba0-a143ad279bee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:08.665626 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cb326762-b209-4c7e-9ba0-a143ad279bee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:08.715798 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-cb326762-b209-4c7e-9ba0-a143ad279bee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] HTTP exception thrown: Instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 could not be found. Feb 28 19:12:08.716405 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cb326762-b209-4c7e-9ba0-a143ad279bee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Returning 404 to user: Instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:12:08.717231 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-cb326762-b209-4c7e-9ba0-a143ad279bee tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 404 len: 111 microversion: 2.20 time: 0.065091 Feb 28 19:12:08.717794 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 405/815] 10.222.0.21 () {60 vars in 1279 bytes} [Mon Feb 28 19:12:08 2022] DELETE /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 28 19:12:08.725733 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f16a519b-5cd6-45ce-93bf-3a5ea82a2df2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:12:08.726384 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f16a519b-5cd6-45ce-93bf-3a5ea82a2df2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] [instance: 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:12:08.734754 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f16a519b-5cd6-45ce-93bf-3a5ea82a2df2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:08.735218 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f16a519b-5cd6-45ce-93bf-3a5ea82a2df2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:08.735979 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f16a519b-5cd6-45ce-93bf-3a5ea82a2df2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:12:08.736411 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f16a519b-5cd6-45ce-93bf-3a5ea82a2df2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:12:08.787434 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-f16a519b-5cd6-45ce-93bf-3a5ea82a2df2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] HTTP exception thrown: Instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 could not be found. Feb 28 19:12:08.788021 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f16a519b-5cd6-45ce-93bf-3a5ea82a2df2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] Returning 404 to user: Instance 7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:12:08.788821 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f16a519b-5cd6-45ce-93bf-3a5ea82a2df2 tempest-AttachVolumeShelveTestJSON-170074604 tempest-AttachVolumeShelveTestJSON-170074604-project] 10.222.0.21 "GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70" status: 404 len: 111 microversion: 2.20 time: 0.066797 Feb 28 19:12:08.789354 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 411/816] 10.222.0.21 () {60 vars in 1276 bytes} [Mon Feb 28 19:12:08 2022] GET /compute/v2.1/servers/7ccb53a1-9359-44b2-b7e1-1b71d1ee9c70 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 28 19:13:05.589963 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1424909566", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:13:05.600027 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0ff264c-44f7-4e38-951f-4edc98ed008f] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 28 19:13:05.657282 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] validate_networks() for None {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:13:06.012386 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:13:06.012809 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:13:06.013277 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:13:06.013692 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:13:06.014101 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:13:06.023054 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:06.023569 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:06.024368 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:06.024807 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:06.044925 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Getting quotas for project c35671b1e3cb4250b1ba2d451be891f8. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:13:06.049030 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Getting quotas for user 7c64d20b2d314e9bbee9699c5be38300 and project c35671b1e3cb4250b1ba2d451be891f8. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:13:06.059597 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:13:06.061868 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:13:06.170574 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-5fd53a89-b87c-453f-8057-62e513f912a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583957 Feb 28 19:13:06.176306 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 406/817] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:13:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:13:06.182727 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7289bde2-e39e-4c22-befd-8ad72d8b20aa tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:06.183376 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7289bde2-e39e-4c22-befd-8ad72d8b20aa tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:06.187233 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: ERROR oslo.messaging._drivers.impl_rabbit [-] [295cd133-f5a7-4657-b76e-4933c04695f5] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 28 19:13:06.256632 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7289bde2-e39e-4c22-befd-8ad72d8b20aa tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:06.263991 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7289bde2-e39e-4c22-befd-8ad72d8b20aa tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1215 microversion: 2.1 time: 0.086246 Feb 28 19:13:06.266709 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 412/818] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:06 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:13:07.281804 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ad8ea156-6877-4297-80fb-127c025223ea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:07.282451 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ad8ea156-6877-4297-80fb-127c025223ea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:07.308999 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0ff264c-44f7-4e38-951f-4edc98ed008f] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 36668. Feb 28 19:13:07.358920 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ad8ea156-6877-4297-80fb-127c025223ea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:07.366750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ad8ea156-6877-4297-80fb-127c025223ea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1215 microversion: 2.1 time: 0.088432 Feb 28 19:13:07.367194 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 407/819] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:07 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:08.382820 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f092c350-784c-4a0c-be9c-4c53e19dead5 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:08.383488 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f092c350-784c-4a0c-be9c-4c53e19dead5 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:08.410560 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] [295cd133-f5a7-4657-b76e-4933c04695f5] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 36676. Feb 28 19:13:08.458674 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f092c350-784c-4a0c-be9c-4c53e19dead5 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:08.466972 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f092c350-784c-4a0c-be9c-4c53e19dead5 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1215 microversion: 2.1 time: 0.087832 Feb 28 19:13:08.467580 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 413/820] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:08 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:09.483923 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ddf7ed72-73c6-484b-94d3-54311b572a17 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:09.484555 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ddf7ed72-73c6-484b-94d3-54311b572a17 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:09.554000 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-ddf7ed72-73c6-484b-94d3-54311b572a17 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:09.561640 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ddf7ed72-73c6-484b-94d3-54311b572a17 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1215 microversion: 2.1 time: 0.081367 Feb 28 19:13:09.562201 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 408/821] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:09 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:10.578559 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6df1cdeb-000c-47e2-acc3-e9138d458b36 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:10.579177 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-6df1cdeb-000c-47e2-acc3-e9138d458b36 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:10.587020 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6df1cdeb-000c-47e2-acc3-e9138d458b36 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:10.587491 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6df1cdeb-000c-47e2-acc3-e9138d458b36 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:10.588255 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6df1cdeb-000c-47e2-acc3-e9138d458b36 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:10.590230 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6df1cdeb-000c-47e2-acc3-e9138d458b36 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:10.702634 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6df1cdeb-000c-47e2-acc3-e9138d458b36 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:10.712129 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6df1cdeb-000c-47e2-acc3-e9138d458b36 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1219 microversion: 2.1 time: 0.137105 Feb 28 19:13:10.712855 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 414/822] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:10 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:11.728937 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f43e4c4d-f65d-450a-a08b-cd2df5f02a00 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:11.729505 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f43e4c4d-f65d-450a-a08b-cd2df5f02a00 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:11.737491 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f43e4c4d-f65d-450a-a08b-cd2df5f02a00 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:11.737934 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f43e4c4d-f65d-450a-a08b-cd2df5f02a00 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:11.738704 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f43e4c4d-f65d-450a-a08b-cd2df5f02a00 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:11.739158 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f43e4c4d-f65d-450a-a08b-cd2df5f02a00 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:11.848857 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f43e4c4d-f65d-450a-a08b-cd2df5f02a00 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:11.856928 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f43e4c4d-f65d-450a-a08b-cd2df5f02a00 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1219 microversion: 2.1 time: 0.131698 Feb 28 19:13:11.857489 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 409/823] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:11 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:12.872866 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2288e488-5ba2-4c5c-b389-95012ba72984 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:12.873396 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-2288e488-5ba2-4c5c-b389-95012ba72984 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:12.880939 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2288e488-5ba2-4c5c-b389-95012ba72984 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:12.881377 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2288e488-5ba2-4c5c-b389-95012ba72984 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:12.882133 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2288e488-5ba2-4c5c-b389-95012ba72984 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:12.882555 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2288e488-5ba2-4c5c-b389-95012ba72984 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:13.000030 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-2288e488-5ba2-4c5c-b389-95012ba72984 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:13.008435 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2288e488-5ba2-4c5c-b389-95012ba72984 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1219 microversion: 2.1 time: 0.139262 Feb 28 19:13:13.008998 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 415/824] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:12 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:14.025156 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b7f1acd0-5975-4f3e-9553-3c28d673d590 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:14.026653 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b7f1acd0-5975-4f3e-9553-3c28d673d590 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:14.034231 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b7f1acd0-5975-4f3e-9553-3c28d673d590 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:14.034685 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b7f1acd0-5975-4f3e-9553-3c28d673d590 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:14.035492 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b7f1acd0-5975-4f3e-9553-3c28d673d590 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:14.035933 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b7f1acd0-5975-4f3e-9553-3c28d673d590 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:14.155849 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b7f1acd0-5975-4f3e-9553-3c28d673d590 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:14.166518 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b7f1acd0-5975-4f3e-9553-3c28d673d590 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1275 microversion: 2.1 time: 0.145040 Feb 28 19:13:14.167096 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 410/825] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:14 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:13:15.184162 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c83b27c4-512d-47e0-862d-7b187d65ad64 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:15.184779 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c83b27c4-512d-47e0-862d-7b187d65ad64 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:15.192965 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c83b27c4-512d-47e0-862d-7b187d65ad64 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:15.193686 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c83b27c4-512d-47e0-862d-7b187d65ad64 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:15.194480 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c83b27c4-512d-47e0-862d-7b187d65ad64 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:15.194917 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c83b27c4-512d-47e0-862d-7b187d65ad64 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:15.419083 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c83b27c4-512d-47e0-862d-7b187d65ad64 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:15.434596 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c83b27c4-512d-47e0-862d-7b187d65ad64 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1315 microversion: 2.1 time: 0.247993 Feb 28 19:13:15.436675 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 416/826] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:15 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:16.452883 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7172495a-82d1-403e-8727-e544900b2336 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:16.453430 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7172495a-82d1-403e-8727-e544900b2336 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:16.462086 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7172495a-82d1-403e-8727-e544900b2336 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:16.462576 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7172495a-82d1-403e-8727-e544900b2336 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:16.463397 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7172495a-82d1-403e-8727-e544900b2336 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:16.463839 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7172495a-82d1-403e-8727-e544900b2336 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:16.758395 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7172495a-82d1-403e-8727-e544900b2336 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:16.766550 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7172495a-82d1-403e-8727-e544900b2336 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1315 microversion: 2.1 time: 0.317554 Feb 28 19:13:16.767145 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 411/827] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:16 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:17.083466 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-1def33b2-09bd-4ae6-a4cc-13e4858d03ef req-e411e7a1-c006-4c8c-ba72-9058500236c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d718293-901a-4171-9426-f77504a2e7ac", "tag": "bcf136c7-e5c8-429d-b97c-fa6ab39aa1d2"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:13:17.086018 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:13:17.086018 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:13:17.098925 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-1def33b2-09bd-4ae6-a4cc-13e4858d03ef req-e411e7a1-c006-4c8c-ba72-9058500236c0 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:17.099532 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-1def33b2-09bd-4ae6-a4cc-13e4858d03ef req-e411e7a1-c006-4c8c-ba72-9058500236c0 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:17.118015 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-1def33b2-09bd-4ae6-a4cc-13e4858d03ef req-e411e7a1-c006-4c8c-ba72-9058500236c0 service nova] Creating event network-changed:bcf136c7-e5c8-429d-b97c-fa6ab39aa1d2 for instance 7d718293-901a-4171-9426-f77504a2e7ac on hv-cinder-83118 Feb 28 19:13:17.122922 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-1def33b2-09bd-4ae6-a4cc-13e4858d03ef req-e411e7a1-c006-4c8c-ba72-9058500236c0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255346 Feb 28 19:13:17.123782 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 417/828] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:13:17.783662 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-50eaa739-03bd-4ccd-8ec5-9ffbbca377dd tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:17.784208 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-50eaa739-03bd-4ccd-8ec5-9ffbbca377dd tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:17.791493 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50eaa739-03bd-4ccd-8ec5-9ffbbca377dd tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:17.799174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50eaa739-03bd-4ccd-8ec5-9ffbbca377dd tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:17.799174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50eaa739-03bd-4ccd-8ec5-9ffbbca377dd tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:17.799174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50eaa739-03bd-4ccd-8ec5-9ffbbca377dd tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:18.028472 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-50eaa739-03bd-4ccd-8ec5-9ffbbca377dd tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:18.037392 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-50eaa739-03bd-4ccd-8ec5-9ffbbca377dd tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1315 microversion: 2.1 time: 0.257386 Feb 28 19:13:18.038143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 412/829] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:17 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:18.633389 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:13:18.634139 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: Mon Feb 28 19:13:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:13:19.054414 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0efa28da-0d5c-48a4-83b3-df98a2f31bae tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:19.055129 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0efa28da-0d5c-48a4-83b3-df98a2f31bae tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:19.062413 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0efa28da-0d5c-48a4-83b3-df98a2f31bae tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:19.062854 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0efa28da-0d5c-48a4-83b3-df98a2f31bae tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:19.063659 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0efa28da-0d5c-48a4-83b3-df98a2f31bae tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:19.064092 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0efa28da-0d5c-48a4-83b3-df98a2f31bae tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:19.257421 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0efa28da-0d5c-48a4-83b3-df98a2f31bae tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:19.265327 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0efa28da-0d5c-48a4-83b3-df98a2f31bae tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1315 microversion: 2.1 time: 0.215076 Feb 28 19:13:19.265887 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 418/830] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:19 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:20.281704 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4e1dda49-1a9c-4f0d-bf30-fe69abe7495e tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:20.282311 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4e1dda49-1a9c-4f0d-bf30-fe69abe7495e tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:20.289802 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4e1dda49-1a9c-4f0d-bf30-fe69abe7495e tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:20.290247 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4e1dda49-1a9c-4f0d-bf30-fe69abe7495e tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:20.291004 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4e1dda49-1a9c-4f0d-bf30-fe69abe7495e tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:20.291459 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4e1dda49-1a9c-4f0d-bf30-fe69abe7495e tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:20.492768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4e1dda49-1a9c-4f0d-bf30-fe69abe7495e tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:20.501153 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4e1dda49-1a9c-4f0d-bf30-fe69abe7495e tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1315 microversion: 2.1 time: 0.223050 Feb 28 19:13:20.501719 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 413/831] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:20 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:21.153281 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1454353030", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1298881284", "security_groups": [{"name": "tempest-secgroup-smoke-691725167"}], "block_device_mapping_v2": [{"uuid": "a6ad92c0-7902-489e-9b8b-f652a38fa2de", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "782279ce-5700-40e2-9c75-fac7ff451ff3"}]}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:13:21.299001 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.network.neutron [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] validate_networks() for [('782279ce-5700-40e2-9c75-fac7ff451ff3', None, None, None)] {{(pid=101791) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:13:21.519324 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a033eecf-e566-4d77-822a-24a97bbc445c tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:21.520251 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a033eecf-e566-4d77-822a-24a97bbc445c tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:21.528276 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a033eecf-e566-4d77-822a-24a97bbc445c tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:21.528721 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a033eecf-e566-4d77-822a-24a97bbc445c tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:21.529505 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a033eecf-e566-4d77-822a-24a97bbc445c tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:21.529970 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a033eecf-e566-4d77-822a-24a97bbc445c tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:22.005320 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a033eecf-e566-4d77-822a-24a97bbc445c tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:22.013374 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a033eecf-e566-4d77-822a-24a97bbc445c tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1315 microversion: 2.1 time: 0.498374 Feb 28 19:13:22.013939 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 414/832] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:21 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:22.035508 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Flavor limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:13:22.035934 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Image limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:13:22.036405 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Flavor pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:13:22.036818 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Image pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:13:22.037229 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:13:22.045408 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:22.045853 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:22.046653 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:22.047089 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:22.067688 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Getting quotas for project 90acc320256d4622a351a587d9f604c3. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:13:22.071632 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Getting quotas for user 59f038939b324d9b8e7214cec4e82933 and project 90acc320256d4622a351a587d9f604c3. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:13:22.160556 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Going to run 1 instances... {{(pid=101791) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:13:22.171487 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a6ad92c0-7902-489e-9b8b-f652a38fa2de',volume_size=None,volume_type=None)] {{(pid=101791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:13:22.602883 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5634f2a8-38d6-4ea8-8b7a-4067b79e06a4 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.453548 Feb 28 19:13:22.603532 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 419/833] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:13:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:13:22.613852 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d91e0372-483b-4951-b02b-c46719ea4cd3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:22.614498 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d91e0372-483b-4951-b02b-c46719ea4cd3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:22.688862 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d91e0372-483b-4951-b02b-c46719ea4cd3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:22.703492 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d91e0372-483b-4951-b02b-c46719ea4cd3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1095 microversion: 2.1 time: 0.090413 Feb 28 19:13:22.703492 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 415/834] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:22 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1095 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:23.030012 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e6dde22a-230a-45dc-b556-d02ca8562f94 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:23.030621 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e6dde22a-230a-45dc-b556-d02ca8562f94 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:23.038920 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e6dde22a-230a-45dc-b556-d02ca8562f94 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:23.039406 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e6dde22a-230a-45dc-b556-d02ca8562f94 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:23.040378 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e6dde22a-230a-45dc-b556-d02ca8562f94 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:23.040816 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e6dde22a-230a-45dc-b556-d02ca8562f94 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:23.272773 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e6dde22a-230a-45dc-b556-d02ca8562f94 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:23.281279 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e6dde22a-230a-45dc-b556-d02ca8562f94 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1315 microversion: 2.1 time: 0.255111 Feb 28 19:13:23.281922 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 420/835] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:23 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:23.715575 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c01324e6-006e-4489-956c-250b0be7fff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:23.716212 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c01324e6-006e-4489-956c-250b0be7fff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:23.724611 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c01324e6-006e-4489-956c-250b0be7fff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:23.724831 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c01324e6-006e-4489-956c-250b0be7fff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:23.725801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c01324e6-006e-4489-956c-250b0be7fff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:23.726391 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c01324e6-006e-4489-956c-250b0be7fff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:23.854621 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c01324e6-006e-4489-956c-250b0be7fff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:23.864142 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c01324e6-006e-4489-956c-250b0be7fff8 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1145 microversion: 2.1 time: 0.152144 Feb 28 19:13:23.866859 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 416/836] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:23 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1145 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:24.300199 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-eafd58c5-dc4e-495b-aab0-23bdbefdf963 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:24.300830 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-eafd58c5-dc4e-495b-aab0-23bdbefdf963 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:24.308914 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eafd58c5-dc4e-495b-aab0-23bdbefdf963 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:24.315602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eafd58c5-dc4e-495b-aab0-23bdbefdf963 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:24.315602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eafd58c5-dc4e-495b-aab0-23bdbefdf963 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:24.315602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eafd58c5-dc4e-495b-aab0-23bdbefdf963 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:24.513692 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-eafd58c5-dc4e-495b-aab0-23bdbefdf963 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:24.522241 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-eafd58c5-dc4e-495b-aab0-23bdbefdf963 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1315 microversion: 2.1 time: 0.226609 Feb 28 19:13:24.523354 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 421/837] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:24 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:24.883465 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b8fd3be6-e9f5-43d2-bbe2-6af16499542c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:24.884140 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b8fd3be6-e9f5-43d2-bbe2-6af16499542c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:24.891609 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8fd3be6-e9f5-43d2-bbe2-6af16499542c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:24.892162 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8fd3be6-e9f5-43d2-bbe2-6af16499542c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:24.893643 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8fd3be6-e9f5-43d2-bbe2-6af16499542c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:24.894303 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b8fd3be6-e9f5-43d2-bbe2-6af16499542c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:25.009473 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b8fd3be6-e9f5-43d2-bbe2-6af16499542c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:25.017835 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b8fd3be6-e9f5-43d2-bbe2-6af16499542c tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1193 microversion: 2.1 time: 0.138042 Feb 28 19:13:25.019554 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 417/838] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:24 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1193 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:25.239902 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-a9f0181f-df5b-437b-ac64-0b52fbba3cfb req-80022dfa-d48a-48d2-b4b6-74729247e0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d718293-901a-4171-9426-f77504a2e7ac", "name": "network-vif-plugged", "status": "completed", "tag": "bcf136c7-e5c8-429d-b97c-fa6ab39aa1d2"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:13:25.242414 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:13:25.242414 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:13:25.251366 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-a9f0181f-df5b-437b-ac64-0b52fbba3cfb req-80022dfa-d48a-48d2-b4b6-74729247e0f0 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:25.252176 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-a9f0181f-df5b-437b-ac64-0b52fbba3cfb req-80022dfa-d48a-48d2-b4b6-74729247e0f0 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:25.272263 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-a9f0181f-df5b-437b-ac64-0b52fbba3cfb req-80022dfa-d48a-48d2-b4b6-74729247e0f0 service nova] Creating event network-vif-plugged:bcf136c7-e5c8-429d-b97c-fa6ab39aa1d2 for instance 7d718293-901a-4171-9426-f77504a2e7ac on hv-cinder-83118 Feb 28 19:13:25.277472 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-a9f0181f-df5b-437b-ac64-0b52fbba3cfb req-80022dfa-d48a-48d2-b4b6-74729247e0f0 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184707 Feb 28 19:13:25.278346 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 422/839] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:13:25.539511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2a926cfe-570d-4dbd-b6e5-bcdf99e35d79 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:25.540144 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2a926cfe-570d-4dbd-b6e5-bcdf99e35d79 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:25.547623 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a926cfe-570d-4dbd-b6e5-bcdf99e35d79 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:25.548069 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a926cfe-570d-4dbd-b6e5-bcdf99e35d79 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:25.548847 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a926cfe-570d-4dbd-b6e5-bcdf99e35d79 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:25.549324 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2a926cfe-570d-4dbd-b6e5-bcdf99e35d79 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:25.811149 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2a926cfe-570d-4dbd-b6e5-bcdf99e35d79 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:25.820697 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2a926cfe-570d-4dbd-b6e5-bcdf99e35d79 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1315 microversion: 2.1 time: 0.284900 Feb 28 19:13:25.821274 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 418/840] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:25 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:26.037541 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-aa2e41f9-015f-460d-a8ec-e460a7ee57e2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:26.038248 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-aa2e41f9-015f-460d-a8ec-e460a7ee57e2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:26.046139 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-aa2e41f9-015f-460d-a8ec-e460a7ee57e2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:26.046587 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-aa2e41f9-015f-460d-a8ec-e460a7ee57e2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:26.047411 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-aa2e41f9-015f-460d-a8ec-e460a7ee57e2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:26.047846 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-aa2e41f9-015f-460d-a8ec-e460a7ee57e2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:26.258965 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-aa2e41f9-015f-460d-a8ec-e460a7ee57e2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:26.268074 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-aa2e41f9-015f-460d-a8ec-e460a7ee57e2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1278 microversion: 2.1 time: 0.235341 Feb 28 19:13:26.269453 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 423/841] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:26 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:26.837202 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-f64e83d9-0970-47cb-882d-731a73cd1cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:26.837819 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-f64e83d9-0970-47cb-882d-731a73cd1cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:26.845588 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f64e83d9-0970-47cb-882d-731a73cd1cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:26.846036 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f64e83d9-0970-47cb-882d-731a73cd1cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:26.847194 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f64e83d9-0970-47cb-882d-731a73cd1cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:26.847639 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-f64e83d9-0970-47cb-882d-731a73cd1cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:27.061875 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-f64e83d9-0970-47cb-882d-731a73cd1cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:27.074194 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-f64e83d9-0970-47cb-882d-731a73cd1cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1315 microversion: 2.1 time: 0.240773 Feb 28 19:13:27.078793 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 419/842] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:26 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:27.287072 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e5911207-756c-46e5-9fbe-401c25526481 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:27.288340 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e5911207-756c-46e5-9fbe-401c25526481 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:27.295880 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e5911207-756c-46e5-9fbe-401c25526481 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:27.296277 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e5911207-756c-46e5-9fbe-401c25526481 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:27.297056 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e5911207-756c-46e5-9fbe-401c25526481 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:27.297492 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e5911207-756c-46e5-9fbe-401c25526481 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:27.501259 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-c199329b-4e88-4b81-a23c-779839382d4f req-13dcb738-a5ab-417f-b8a2-ec657c5d7e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a389097e-88f3-40cf-a37d-8ab80c1aadc5", "tag": "15c20d67-5dfd-43c2-84f1-6f01de9fa67e"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:13:27.503139 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:13:27.503139 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:13:27.517188 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e5911207-756c-46e5-9fbe-401c25526481 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:27.519436 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-c199329b-4e88-4b81-a23c-779839382d4f req-13dcb738-a5ab-417f-b8a2-ec657c5d7e9e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:27.520249 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-c199329b-4e88-4b81-a23c-779839382d4f req-13dcb738-a5ab-417f-b8a2-ec657c5d7e9e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:27.535995 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e5911207-756c-46e5-9fbe-401c25526481 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.253743 Feb 28 19:13:27.539242 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-c199329b-4e88-4b81-a23c-779839382d4f req-13dcb738-a5ab-417f-b8a2-ec657c5d7e9e service nova] Creating event network-changed:15c20d67-5dfd-43c2-84f1-6f01de9fa67e for instance a389097e-88f3-40cf-a37d-8ab80c1aadc5 on hv-cinder-83118 Feb 28 19:13:27.542632 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: ERROR oslo.messaging._drivers.impl_rabbit [req-c199329b-4e88-4b81-a23c-779839382d4f req-13dcb738-a5ab-417f-b8a2-ec657c5d7e9e service nova] [4dcd5d3c-aae7-405d-bd54-36c742a07437] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 28 19:13:27.545674 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 424/843] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:27 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:28.095238 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5ac5cee6-6c42-4778-9b34-526aa83501a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:28.095876 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5ac5cee6-6c42-4778-9b34-526aa83501a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:28.103508 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5ac5cee6-6c42-4778-9b34-526aa83501a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:28.103958 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5ac5cee6-6c42-4778-9b34-526aa83501a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:28.104747 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5ac5cee6-6c42-4778-9b34-526aa83501a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:28.105179 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5ac5cee6-6c42-4778-9b34-526aa83501a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:28.308380 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5ac5cee6-6c42-4778-9b34-526aa83501a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:28.317533 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5ac5cee6-6c42-4778-9b34-526aa83501a3 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1464 microversion: 2.1 time: 0.226056 Feb 28 19:13:28.318108 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 425/844] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:28 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1464 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:13:28.389223 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0128f042-f14d-44e1-b87b-852165918ae8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:28.389734 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0128f042-f14d-44e1-b87b-852165918ae8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:28.397367 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0128f042-f14d-44e1-b87b-852165918ae8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:28.398178 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0128f042-f14d-44e1-b87b-852165918ae8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:28.398643 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0128f042-f14d-44e1-b87b-852165918ae8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:28.399093 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0128f042-f14d-44e1-b87b-852165918ae8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:28.462620 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0128f042-f14d-44e1-b87b-852165918ae8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Going to try to terminate instance {{(pid=101791) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:13:28.551392 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [req-c199329b-4e88-4b81-a23c-779839382d4f req-13dcb738-a5ab-417f-b8a2-ec657c5d7e9e service nova] [4dcd5d3c-aae7-405d-bd54-36c742a07437] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 36950. Feb 28 19:13:28.555068 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-c199329b-4e88-4b81-a23c-779839382d4f req-13dcb738-a5ab-417f-b8a2-ec657c5d7e9e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.057564 Feb 28 19:13:28.556082 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 420/845] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:13:28.561104 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a87adc2d-2adb-4b24-a81d-ad694200c6f9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:28.562490 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a87adc2d-2adb-4b24-a81d-ad694200c6f9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:28.571590 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a87adc2d-2adb-4b24-a81d-ad694200c6f9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:28.579540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a87adc2d-2adb-4b24-a81d-ad694200c6f9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:28.579540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a87adc2d-2adb-4b24-a81d-ad694200c6f9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:28.579540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a87adc2d-2adb-4b24-a81d-ad694200c6f9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:28.775351 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a87adc2d-2adb-4b24-a81d-ad694200c6f9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:28.786563 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a87adc2d-2adb-4b24-a81d-ad694200c6f9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.229218 Feb 28 19:13:28.787441 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 421/846] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:28 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:28.932711 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0128f042-f14d-44e1-b87b-852165918ae8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "DELETE /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 204 len: 0 microversion: 2.1 time: 0.546828 Feb 28 19:13:28.937502 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 426/847] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:13:28 2022] DELETE /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 28 19:13:28.943164 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-5e2945db-7a4e-4fff-a6ff-1edb6aee3ffb tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:28.944083 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5e2945db-7a4e-4fff-a6ff-1edb6aee3ffb tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:28.951893 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5e2945db-7a4e-4fff-a6ff-1edb6aee3ffb tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:28.952869 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5e2945db-7a4e-4fff-a6ff-1edb6aee3ffb tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:28.953921 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5e2945db-7a4e-4fff-a6ff-1edb6aee3ffb tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:28.954574 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5e2945db-7a4e-4fff-a6ff-1edb6aee3ffb tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:29.155047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-5e2945db-7a4e-4fff-a6ff-1edb6aee3ffb tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:29.163515 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-5e2945db-7a4e-4fff-a6ff-1edb6aee3ffb tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1470 microversion: 2.1 time: 0.224772 Feb 28 19:13:29.164085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 422/848] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:28 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:29.803689 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ad470e07-f36e-4412-a483-a756c85f9444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:29.804379 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ad470e07-f36e-4412-a483-a756c85f9444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:29.811515 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ad470e07-f36e-4412-a483-a756c85f9444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:29.811961 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ad470e07-f36e-4412-a483-a756c85f9444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:29.812715 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ad470e07-f36e-4412-a483-a756c85f9444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:29.813140 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ad470e07-f36e-4412-a483-a756c85f9444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:30.011473 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ad470e07-f36e-4412-a483-a756c85f9444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:30.020316 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ad470e07-f36e-4412-a483-a756c85f9444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.220964 Feb 28 19:13:30.020877 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 427/849] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:29 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:30.180137 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0c41a453-c6f6-4c40-9c57-7a1f12efffd1 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:30.180738 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0c41a453-c6f6-4c40-9c57-7a1f12efffd1 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:30.188024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0c41a453-c6f6-4c40-9c57-7a1f12efffd1 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:30.188470 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0c41a453-c6f6-4c40-9c57-7a1f12efffd1 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:30.189226 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0c41a453-c6f6-4c40-9c57-7a1f12efffd1 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:30.190183 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0c41a453-c6f6-4c40-9c57-7a1f12efffd1 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:30.383137 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0c41a453-c6f6-4c40-9c57-7a1f12efffd1 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:30.391153 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0c41a453-c6f6-4c40-9c57-7a1f12efffd1 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1470 microversion: 2.1 time: 0.214630 Feb 28 19:13:30.391719 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 423/850] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:30 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:31.037563 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a3171a2a-4434-44c9-9063-ac8d7db7bf0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:31.038169 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a3171a2a-4434-44c9-9063-ac8d7db7bf0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:31.045287 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a3171a2a-4434-44c9-9063-ac8d7db7bf0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:31.045728 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a3171a2a-4434-44c9-9063-ac8d7db7bf0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:31.046490 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a3171a2a-4434-44c9-9063-ac8d7db7bf0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:31.046914 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a3171a2a-4434-44c9-9063-ac8d7db7bf0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:31.258418 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a3171a2a-4434-44c9-9063-ac8d7db7bf0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:31.266397 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a3171a2a-4434-44c9-9063-ac8d7db7bf0d tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.233051 Feb 28 19:13:31.268204 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 428/851] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:31 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:31.409992 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a908c10f-fcad-4581-a825-05a38dfba3a8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:31.411437 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a908c10f-fcad-4581-a825-05a38dfba3a8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:31.420022 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a908c10f-fcad-4581-a825-05a38dfba3a8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:31.421418 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a908c10f-fcad-4581-a825-05a38dfba3a8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:31.422874 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a908c10f-fcad-4581-a825-05a38dfba3a8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:31.429626 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a908c10f-fcad-4581-a825-05a38dfba3a8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:31.476474 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-3f98f752-0a8d-4f2e-8771-1d2f2fad0e6a req-0fae6afd-09b7-4ad1-b9a6-62539bdd48f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d718293-901a-4171-9426-f77504a2e7ac", "name": "network-vif-deleted", "tag": "bcf136c7-e5c8-429d-b97c-fa6ab39aa1d2"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:13:31.478099 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:13:31.478099 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:13:31.486435 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-3f98f752-0a8d-4f2e-8771-1d2f2fad0e6a req-0fae6afd-09b7-4ad1-b9a6-62539bdd48f4 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:31.490968 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-3f98f752-0a8d-4f2e-8771-1d2f2fad0e6a req-0fae6afd-09b7-4ad1-b9a6-62539bdd48f4 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:31.563895 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a908c10f-fcad-4581-a825-05a38dfba3a8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:31.573507 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a908c10f-fcad-4581-a825-05a38dfba3a8 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1428 microversion: 2.1 time: 0.168432 Feb 28 19:13:31.574100 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 424/852] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:31 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1428 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:31.685078 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-3f98f752-0a8d-4f2e-8771-1d2f2fad0e6a req-0fae6afd-09b7-4ad1-b9a6-62539bdd48f4 service nova] Creating event network-vif-deleted:bcf136c7-e5c8-429d-b97c-fa6ab39aa1d2 for instance 7d718293-901a-4171-9426-f77504a2e7ac on hv-cinder-83118 Feb 28 19:13:31.691298 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-3f98f752-0a8d-4f2e-8771-1d2f2fad0e6a req-0fae6afd-09b7-4ad1-b9a6-62539bdd48f4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220889 Feb 28 19:13:31.691888 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 429/853] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:13:32.283222 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-dc05d81e-7b69-45a4-bf78-8055b3f5965e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:32.284277 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-dc05d81e-7b69-45a4-bf78-8055b3f5965e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:32.291882 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dc05d81e-7b69-45a4-bf78-8055b3f5965e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:32.293726 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dc05d81e-7b69-45a4-bf78-8055b3f5965e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:32.293726 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dc05d81e-7b69-45a4-bf78-8055b3f5965e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:32.293726 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dc05d81e-7b69-45a4-bf78-8055b3f5965e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:32.490390 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dc05d81e-7b69-45a4-bf78-8055b3f5965e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:32.498663 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-dc05d81e-7b69-45a4-bf78-8055b3f5965e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.219208 Feb 28 19:13:32.499255 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 425/854] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:32 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:32.591786 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-01d2abda-4123-479c-b8bf-35a35d2f4cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:32.592804 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-01d2abda-4123-479c-b8bf-35a35d2f4cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:32.601145 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-01d2abda-4123-479c-b8bf-35a35d2f4cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:32.601585 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-01d2abda-4123-479c-b8bf-35a35d2f4cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:32.602386 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-01d2abda-4123-479c-b8bf-35a35d2f4cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:32.602813 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-01d2abda-4123-479c-b8bf-35a35d2f4cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:32.670045 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-01d2abda-4123-479c-b8bf-35a35d2f4cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:32.671834 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-01d2abda-4123-479c-b8bf-35a35d2f4cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:32.671834 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-01d2abda-4123-479c-b8bf-35a35d2f4cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lazy-loading 'fault' on Instance uuid 7d718293-901a-4171-9426-f77504a2e7ac {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:13:32.730348 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-01d2abda-4123-479c-b8bf-35a35d2f4cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:32.738650 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-01d2abda-4123-479c-b8bf-35a35d2f4cea tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1305 microversion: 2.1 time: 0.150926 Feb 28 19:13:32.739216 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 430/855] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:32 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1305 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:33.515202 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a2f3765a-f4a1-4ed9-bc53-af711377e762 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:33.515846 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a2f3765a-f4a1-4ed9-bc53-af711377e762 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:33.523193 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2f3765a-f4a1-4ed9-bc53-af711377e762 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:33.523643 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2f3765a-f4a1-4ed9-bc53-af711377e762 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:33.524417 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2f3765a-f4a1-4ed9-bc53-af711377e762 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:33.524850 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2f3765a-f4a1-4ed9-bc53-af711377e762 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:33.720102 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a2f3765a-f4a1-4ed9-bc53-af711377e762 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:33.729293 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a2f3765a-f4a1-4ed9-bc53-af711377e762 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.217806 Feb 28 19:13:33.729851 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 426/856] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:33 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:33.754754 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-48a8cb2e-e602-4fd4-9f03-512fb3c06ebc tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:33.755408 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-48a8cb2e-e602-4fd4-9f03-512fb3c06ebc tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:33.762664 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-48a8cb2e-e602-4fd4-9f03-512fb3c06ebc tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:33.763128 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-48a8cb2e-e602-4fd4-9f03-512fb3c06ebc tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:33.763912 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-48a8cb2e-e602-4fd4-9f03-512fb3c06ebc tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:33.764349 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-48a8cb2e-e602-4fd4-9f03-512fb3c06ebc tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:33.831565 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-48a8cb2e-e602-4fd4-9f03-512fb3c06ebc tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:33.831938 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-48a8cb2e-e602-4fd4-9f03-512fb3c06ebc tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:33.832388 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-48a8cb2e-e602-4fd4-9f03-512fb3c06ebc tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lazy-loading 'fault' on Instance uuid 7d718293-901a-4171-9426-f77504a2e7ac {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:13:33.887831 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-48a8cb2e-e602-4fd4-9f03-512fb3c06ebc tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:33.896709 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-48a8cb2e-e602-4fd4-9f03-512fb3c06ebc tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1305 microversion: 2.1 time: 0.145710 Feb 28 19:13:33.897278 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 431/857] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:33 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1305 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:34.745332 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e3d92829-6d41-485d-b3c1-a1c9c593cd5a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:34.745937 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e3d92829-6d41-485d-b3c1-a1c9c593cd5a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:34.753887 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e3d92829-6d41-485d-b3c1-a1c9c593cd5a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:34.754326 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e3d92829-6d41-485d-b3c1-a1c9c593cd5a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:34.755086 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e3d92829-6d41-485d-b3c1-a1c9c593cd5a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:34.755540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e3d92829-6d41-485d-b3c1-a1c9c593cd5a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:34.913314 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4b166c60-69b2-4b9a-a063-8a9d29476e8f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:34.913913 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4b166c60-69b2-4b9a-a063-8a9d29476e8f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:34.922107 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4b166c60-69b2-4b9a-a063-8a9d29476e8f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:34.923417 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4b166c60-69b2-4b9a-a063-8a9d29476e8f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:34.924217 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4b166c60-69b2-4b9a-a063-8a9d29476e8f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:34.925136 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4b166c60-69b2-4b9a-a063-8a9d29476e8f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:34.997498 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4b166c60-69b2-4b9a-a063-8a9d29476e8f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:34.997938 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4b166c60-69b2-4b9a-a063-8a9d29476e8f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:34.998381 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-4b166c60-69b2-4b9a-a063-8a9d29476e8f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lazy-loading 'fault' on Instance uuid 7d718293-901a-4171-9426-f77504a2e7ac {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:13:35.077543 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4b166c60-69b2-4b9a-a063-8a9d29476e8f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:35.085578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4b166c60-69b2-4b9a-a063-8a9d29476e8f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1305 microversion: 2.1 time: 0.175736 Feb 28 19:13:35.086144 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 432/858] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:34 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1305 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:13:35.087511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e3d92829-6d41-485d-b3c1-a1c9c593cd5a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:35.095553 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e3d92829-6d41-485d-b3c1-a1c9c593cd5a tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.353777 Feb 28 19:13:35.096104 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 427/859] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:34 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:36.102437 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-fa65b203-bfd8-40c0-923e-53663a792e35 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:36.103049 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-fa65b203-bfd8-40c0-923e-53663a792e35 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:36.110312 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fa65b203-bfd8-40c0-923e-53663a792e35 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:36.110751 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fa65b203-bfd8-40c0-923e-53663a792e35 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:36.111550 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fa65b203-bfd8-40c0-923e-53663a792e35 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:36.111656 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-5b7a187e-4873-4d83-94e4-7d022c6a5444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:36.112075 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fa65b203-bfd8-40c0-923e-53663a792e35 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:36.112213 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5b7a187e-4873-4d83-94e4-7d022c6a5444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:36.119943 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5b7a187e-4873-4d83-94e4-7d022c6a5444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:36.120392 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5b7a187e-4873-4d83-94e4-7d022c6a5444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:36.121158 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5b7a187e-4873-4d83-94e4-7d022c6a5444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:36.121600 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5b7a187e-4873-4d83-94e4-7d022c6a5444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:36.179776 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fa65b203-bfd8-40c0-923e-53663a792e35 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:36.180267 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fa65b203-bfd8-40c0-923e-53663a792e35 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:36.180657 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-fa65b203-bfd8-40c0-923e-53663a792e35 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lazy-loading 'fault' on Instance uuid 7d718293-901a-4171-9426-f77504a2e7ac {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:13:36.268004 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-fa65b203-bfd8-40c0-923e-53663a792e35 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c64d20b2d314e9bbee9699c5be38300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35671b1e3cb4250b1ba2d451be891f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:36.277357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-fa65b203-bfd8-40c0-923e-53663a792e35 tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 200 len: 1305 microversion: 2.1 time: 0.178503 Feb 28 19:13:36.277961 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 433/860] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:36 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:36.365030 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-5b7a187e-4873-4d83-94e4-7d022c6a5444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:36.373157 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-5b7a187e-4873-4d83-94e4-7d022c6a5444 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.265105 Feb 28 19:13:36.374167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 428/861] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:36 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:13:37.293359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-68719d0a-717c-429e-80b2-165b7881c05f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:37.293962 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-68719d0a-717c-429e-80b2-165b7881c05f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] [instance: 7d718293-901a-4171-9426-f77504a2e7ac] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:37.302270 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68719d0a-717c-429e-80b2-165b7881c05f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:37.302711 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68719d0a-717c-429e-80b2-165b7881c05f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:37.303500 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68719d0a-717c-429e-80b2-165b7881c05f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:37.303928 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-68719d0a-717c-429e-80b2-165b7881c05f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:37.353120 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-68719d0a-717c-429e-80b2-165b7881c05f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] HTTP exception thrown: Instance 7d718293-901a-4171-9426-f77504a2e7ac could not be found. Feb 28 19:13:37.353980 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-68719d0a-717c-429e-80b2-165b7881c05f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] Returning 404 to user: Instance 7d718293-901a-4171-9426-f77504a2e7ac could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:13:37.354789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-68719d0a-717c-429e-80b2-165b7881c05f tempest-VolumesNegativeTest-1310139091 tempest-VolumesNegativeTest-1310139091-project] 10.222.0.21 "GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac" status: 404 len: 111 microversion: 2.1 time: 0.065212 Feb 28 19:13:37.355344 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 434/862] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:37 2022] GET /compute/v2.1/servers/7d718293-901a-4171-9426-f77504a2e7ac => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:13:37.390718 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-34284ad2-3e22-4c9c-8fb2-721392d12741 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:37.391360 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-34284ad2-3e22-4c9c-8fb2-721392d12741 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:37.398470 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-34284ad2-3e22-4c9c-8fb2-721392d12741 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:37.398917 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-34284ad2-3e22-4c9c-8fb2-721392d12741 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:37.399716 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-34284ad2-3e22-4c9c-8fb2-721392d12741 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:37.400150 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-34284ad2-3e22-4c9c-8fb2-721392d12741 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:37.598749 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-34284ad2-3e22-4c9c-8fb2-721392d12741 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:37.606758 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-34284ad2-3e22-4c9c-8fb2-721392d12741 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.219913 Feb 28 19:13:37.608319 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 429/863] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:37 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:38.625594 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9f3266e0-5300-4239-9ebb-2d505cbafd43 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:38.626209 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9f3266e0-5300-4239-9ebb-2d505cbafd43 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:38.634229 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9f3266e0-5300-4239-9ebb-2d505cbafd43 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:38.634759 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9f3266e0-5300-4239-9ebb-2d505cbafd43 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:38.635644 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9f3266e0-5300-4239-9ebb-2d505cbafd43 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:38.636388 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9f3266e0-5300-4239-9ebb-2d505cbafd43 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:38.840873 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9f3266e0-5300-4239-9ebb-2d505cbafd43 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:38.850765 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9f3266e0-5300-4239-9ebb-2d505cbafd43 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.229931 Feb 28 19:13:38.853693 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 435/864] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:38 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:39.867426 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1bb3bca5-b2f1-4162-9f2b-936f4b397a97 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:39.868064 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1bb3bca5-b2f1-4162-9f2b-936f4b397a97 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:39.875282 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1bb3bca5-b2f1-4162-9f2b-936f4b397a97 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:39.875720 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1bb3bca5-b2f1-4162-9f2b-936f4b397a97 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:39.876477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1bb3bca5-b2f1-4162-9f2b-936f4b397a97 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:39.876902 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1bb3bca5-b2f1-4162-9f2b-936f4b397a97 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:40.074042 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1bb3bca5-b2f1-4162-9f2b-936f4b397a97 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:40.082662 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1bb3bca5-b2f1-4162-9f2b-936f4b397a97 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.219097 Feb 28 19:13:40.083255 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 430/865] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:39 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:40.890034 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:13:40.890674 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: Mon Feb 28 19:13:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:13:41.100331 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4e6395f4-65d3-4324-8d27-f96c8c3d98b7 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:41.101060 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4e6395f4-65d3-4324-8d27-f96c8c3d98b7 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:41.108217 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4e6395f4-65d3-4324-8d27-f96c8c3d98b7 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:41.108656 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4e6395f4-65d3-4324-8d27-f96c8c3d98b7 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:41.109428 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4e6395f4-65d3-4324-8d27-f96c8c3d98b7 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:41.109882 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4e6395f4-65d3-4324-8d27-f96c8c3d98b7 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:41.159726 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-48a34e86-d72b-4694-9d9c-957397d8b0a1 req-ac2a88ab-8134-47c7-a943-8b0fe8d34de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a389097e-88f3-40cf-a37d-8ab80c1aadc5", "name": "network-vif-plugged", "status": "completed", "tag": "15c20d67-5dfd-43c2-84f1-6f01de9fa67e"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:13:41.161741 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:13:41.161741 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:13:41.172414 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-48a34e86-d72b-4694-9d9c-957397d8b0a1 req-ac2a88ab-8134-47c7-a943-8b0fe8d34de7 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:41.172414 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-48a34e86-d72b-4694-9d9c-957397d8b0a1 req-ac2a88ab-8134-47c7-a943-8b0fe8d34de7 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:41.188822 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-48a34e86-d72b-4694-9d9c-957397d8b0a1 req-ac2a88ab-8134-47c7-a943-8b0fe8d34de7 service nova] Creating event network-vif-plugged:15c20d67-5dfd-43c2-84f1-6f01de9fa67e for instance a389097e-88f3-40cf-a37d-8ab80c1aadc5 on hv-cinder-83118 Feb 28 19:13:41.194733 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-48a34e86-d72b-4694-9d9c-957397d8b0a1 req-ac2a88ab-8134-47c7-a943-8b0fe8d34de7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042062 Feb 28 19:13:41.195858 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 431/866] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:13:41.325508 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4e6395f4-65d3-4324-8d27-f96c8c3d98b7 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:41.335002 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4e6395f4-65d3-4324-8d27-f96c8c3d98b7 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.239406 Feb 28 19:13:41.335750 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 436/867] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:41 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:42.358422 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-50dcea0d-a6ca-47c9-9d3f-d01aa04df555 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:42.359289 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-50dcea0d-a6ca-47c9-9d3f-d01aa04df555 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:42.367728 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50dcea0d-a6ca-47c9-9d3f-d01aa04df555 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:42.368238 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50dcea0d-a6ca-47c9-9d3f-d01aa04df555 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:42.369022 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50dcea0d-a6ca-47c9-9d3f-d01aa04df555 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:42.370635 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-50dcea0d-a6ca-47c9-9d3f-d01aa04df555 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:42.713812 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-50dcea0d-a6ca-47c9-9d3f-d01aa04df555 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:42.724112 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-50dcea0d-a6ca-47c9-9d3f-d01aa04df555 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1266 microversion: 2.1 time: 0.369753 Feb 28 19:13:42.724866 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 432/868] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:42 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:43.740899 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cf233c58-6bf1-4c80-aa54-04cb7208a416 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:43.742296 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-cf233c58-6bf1-4c80-aa54-04cb7208a416 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:43.750245 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cf233c58-6bf1-4c80-aa54-04cb7208a416 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:43.750716 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cf233c58-6bf1-4c80-aa54-04cb7208a416 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:43.751517 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cf233c58-6bf1-4c80-aa54-04cb7208a416 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:43.751948 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cf233c58-6bf1-4c80-aa54-04cb7208a416 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:43.953410 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-cf233c58-6bf1-4c80-aa54-04cb7208a416 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:43.962624 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-cf233c58-6bf1-4c80-aa54-04cb7208a416 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1453 microversion: 2.1 time: 0.225543 Feb 28 19:13:43.963214 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 437/869] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:43 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1453 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:43.980445 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d80fb6ad-ae0a-482b-95bb-7e3d564da581 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:43.981146 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d80fb6ad-ae0a-482b-95bb-7e3d564da581 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:43.990740 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d80fb6ad-ae0a-482b-95bb-7e3d564da581 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:43.992128 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d80fb6ad-ae0a-482b-95bb-7e3d564da581 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:43.992862 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d80fb6ad-ae0a-482b-95bb-7e3d564da581 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:43.993300 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d80fb6ad-ae0a-482b-95bb-7e3d564da581 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:44.300919 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d80fb6ad-ae0a-482b-95bb-7e3d564da581 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:44.309095 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d80fb6ad-ae0a-482b-95bb-7e3d564da581 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1453 microversion: 2.1 time: 0.332961 Feb 28 19:13:44.309655 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 433/870] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:43 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1453 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:47.693479 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-6d955990-cbc3-4be6-98b1-87b79a53b815 req-d4e74da5-35b9-4342-940e-4e0607903aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a389097e-88f3-40cf-a37d-8ab80c1aadc5", "tag": "15c20d67-5dfd-43c2-84f1-6f01de9fa67e"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:13:47.695495 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:13:47.695495 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:13:47.703799 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-6d955990-cbc3-4be6-98b1-87b79a53b815 req-d4e74da5-35b9-4342-940e-4e0607903aa9 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:47.704231 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-6d955990-cbc3-4be6-98b1-87b79a53b815 req-d4e74da5-35b9-4342-940e-4e0607903aa9 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:47.720801 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-6d955990-cbc3-4be6-98b1-87b79a53b815 req-d4e74da5-35b9-4342-940e-4e0607903aa9 service nova] Creating event network-changed:15c20d67-5dfd-43c2-84f1-6f01de9fa67e for instance a389097e-88f3-40cf-a37d-8ab80c1aadc5 on hv-cinder-83118 Feb 28 19:13:47.726468 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-6d955990-cbc3-4be6-98b1-87b79a53b815 req-d4e74da5-35b9-4342-940e-4e0607903aa9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036914 Feb 28 19:13:47.729210 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 438/871] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:13:51.352172 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1746496679", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "networks": [{"uuid": "686c36cb-f669-4810-83b3-a9d37b1a6ff3"}]}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:13:51.418164 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] validate_networks() for [('686c36cb-f669-4810-83b3-a9d37b1a6ff3', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:13:52.170670 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:13:52.171093 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:13:52.171612 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:13:52.172020 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:13:52.172430 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:13:52.181154 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:52.181781 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:52.187037 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:52.187037 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:52.200004 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Getting quotas for project 1c06762c8979480f92330ac600b63c5c. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:13:52.204060 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Getting quotas for user 8668df273a9344938c66d1ee69a42238 and project 1c06762c8979480f92330ac600b63c5c. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:13:52.215762 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:13:52.218094 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:13:52.351823 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-22936eb8-3159-4b31-a658-c6e12f9d7ea7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003500 Feb 28 19:13:52.352380 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 434/872] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:13:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:13:52.362900 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6b679019-71e7-483e-955b-3f1d5b2b8b09 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:52.363632 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-6b679019-71e7-483e-955b-3f1d5b2b8b09 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:52.433739 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6b679019-71e7-483e-955b-3f1d5b2b8b09 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:52.441677 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6b679019-71e7-483e-955b-3f1d5b2b8b09 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1219 microversion: 2.1 time: 0.082906 Feb 28 19:13:52.442237 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 439/873] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:52 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:53.458340 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-593149c9-c87e-41f8-a220-369540f43993 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:53.458937 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-593149c9-c87e-41f8-a220-369540f43993 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:53.467238 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-593149c9-c87e-41f8-a220-369540f43993 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:53.468511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-593149c9-c87e-41f8-a220-369540f43993 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:53.468511 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-593149c9-c87e-41f8-a220-369540f43993 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:53.468864 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-593149c9-c87e-41f8-a220-369540f43993 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:53.592072 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-593149c9-c87e-41f8-a220-369540f43993 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:53.600445 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-593149c9-c87e-41f8-a220-369540f43993 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1223 microversion: 2.1 time: 0.146532 Feb 28 19:13:53.601003 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 435/874] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:53 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1223 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:54.617988 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b1e864a3-6857-4bf5-bc45-16ce8b136226 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:54.618603 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b1e864a3-6857-4bf5-bc45-16ce8b136226 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:54.627084 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1e864a3-6857-4bf5-bc45-16ce8b136226 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:54.628231 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1e864a3-6857-4bf5-bc45-16ce8b136226 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:54.628231 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1e864a3-6857-4bf5-bc45-16ce8b136226 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:54.628414 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1e864a3-6857-4bf5-bc45-16ce8b136226 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:54.746043 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b1e864a3-6857-4bf5-bc45-16ce8b136226 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:54.754732 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b1e864a3-6857-4bf5-bc45-16ce8b136226 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1271 microversion: 2.1 time: 0.140411 Feb 28 19:13:54.755314 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 440/875] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:54 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1271 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:55.771960 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6f773949-5ff0-486a-aaa3-2d7ed1e5e1c0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:55.773607 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6f773949-5ff0-486a-aaa3-2d7ed1e5e1c0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:55.780141 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6f773949-5ff0-486a-aaa3-2d7ed1e5e1c0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:55.780598 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6f773949-5ff0-486a-aaa3-2d7ed1e5e1c0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:55.781335 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6f773949-5ff0-486a-aaa3-2d7ed1e5e1c0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:55.781931 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6f773949-5ff0-486a-aaa3-2d7ed1e5e1c0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:56.311791 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6f773949-5ff0-486a-aaa3-2d7ed1e5e1c0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:56.320666 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6f773949-5ff0-486a-aaa3-2d7ed1e5e1c0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1319 microversion: 2.1 time: 0.552424 Feb 28 19:13:56.321229 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 436/876] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:55 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:57.339444 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-28652786-668c-458a-a883-c29a8336bd8d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:57.340379 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-28652786-668c-458a-a883-c29a8336bd8d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:57.351634 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28652786-668c-458a-a883-c29a8336bd8d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:57.352134 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28652786-668c-458a-a883-c29a8336bd8d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:57.353136 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28652786-668c-458a-a883-c29a8336bd8d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:57.353677 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-28652786-668c-458a-a883-c29a8336bd8d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:57.386656 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-35c22c46-f693-4dd3-b4d7-c3b0189a1aa5 req-23742e29-4e37-432f-88a6-d8205c7fee4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba645b2e-2ff8-46d4-8a64-9723a78988e4", "tag": "65f2774c-b61c-4e53-91c1-fbb8f22b4299"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:13:57.387480 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:13:57.387480 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:13:57.400425 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-35c22c46-f693-4dd3-b4d7-c3b0189a1aa5 req-23742e29-4e37-432f-88a6-d8205c7fee4e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:57.401447 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-35c22c46-f693-4dd3-b4d7-c3b0189a1aa5 req-23742e29-4e37-432f-88a6-d8205c7fee4e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:57.419300 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-35c22c46-f693-4dd3-b4d7-c3b0189a1aa5 req-23742e29-4e37-432f-88a6-d8205c7fee4e service nova] Creating event network-changed:65f2774c-b61c-4e53-91c1-fbb8f22b4299 for instance ba645b2e-2ff8-46d4-8a64-9723a78988e4 on hv-cinder-83118 Feb 28 19:13:57.424362 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-35c22c46-f693-4dd3-b4d7-c3b0189a1aa5 req-23742e29-4e37-432f-88a6-d8205c7fee4e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185667 Feb 28 19:13:57.425009 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 441/877] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:13:57.804329 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-28652786-668c-458a-a883-c29a8336bd8d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:57.812496 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-28652786-668c-458a-a883-c29a8336bd8d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1319 microversion: 2.1 time: 0.477766 Feb 28 19:13:57.813061 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 437/878] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:57 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1319 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:13:58.830868 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d2667601-4f28-4242-8aa9-b8185614d386 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:13:58.831625 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d2667601-4f28-4242-8aa9-b8185614d386 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:13:58.839043 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d2667601-4f28-4242-8aa9-b8185614d386 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:58.839533 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d2667601-4f28-4242-8aa9-b8185614d386 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:58.840311 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d2667601-4f28-4242-8aa9-b8185614d386 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:13:58.840747 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d2667601-4f28-4242-8aa9-b8185614d386 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:13:59.040699 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d2667601-4f28-4242-8aa9-b8185614d386 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:13:59.049091 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d2667601-4f28-4242-8aa9-b8185614d386 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1319 microversion: 2.1 time: 0.222885 Feb 28 19:13:59.049655 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 442/879] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:13:58 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:14:00.065896 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8781ee93-eb78-444a-b4f6-f8456c8c7788 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:14:00.066508 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8781ee93-eb78-444a-b4f6-f8456c8c7788 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:14:00.073648 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8781ee93-eb78-444a-b4f6-f8456c8c7788 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:00.074094 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8781ee93-eb78-444a-b4f6-f8456c8c7788 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:00.074853 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8781ee93-eb78-444a-b4f6-f8456c8c7788 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:00.075312 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8781ee93-eb78-444a-b4f6-f8456c8c7788 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:00.273758 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8781ee93-eb78-444a-b4f6-f8456c8c7788 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:14:00.282333 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8781ee93-eb78-444a-b4f6-f8456c8c7788 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1319 microversion: 2.1 time: 0.220115 Feb 28 19:14:00.285493 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 438/880] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:14:00 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:14:01.300354 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c81f7bb3-225d-4363-aff9-c780e71b7192 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:14:01.300991 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c81f7bb3-225d-4363-aff9-c780e71b7192 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:14:01.308352 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c81f7bb3-225d-4363-aff9-c780e71b7192 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:01.308784 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c81f7bb3-225d-4363-aff9-c780e71b7192 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:01.309554 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c81f7bb3-225d-4363-aff9-c780e71b7192 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:01.309981 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c81f7bb3-225d-4363-aff9-c780e71b7192 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:01.516016 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c81f7bb3-225d-4363-aff9-c780e71b7192 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:14:01.524640 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c81f7bb3-225d-4363-aff9-c780e71b7192 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1319 microversion: 2.1 time: 0.228485 Feb 28 19:14:01.525201 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 443/881] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:14:01 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:14:02.541857 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0b1d24f7-c2bc-4fb2-bde0-c8d49dc64fb9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:14:02.542463 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0b1d24f7-c2bc-4fb2-bde0-c8d49dc64fb9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:14:02.550341 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0b1d24f7-c2bc-4fb2-bde0-c8d49dc64fb9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:02.550779 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0b1d24f7-c2bc-4fb2-bde0-c8d49dc64fb9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:02.551571 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0b1d24f7-c2bc-4fb2-bde0-c8d49dc64fb9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:02.551998 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0b1d24f7-c2bc-4fb2-bde0-c8d49dc64fb9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:02.756595 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0b1d24f7-c2bc-4fb2-bde0-c8d49dc64fb9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:14:02.764815 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0b1d24f7-c2bc-4fb2-bde0-c8d49dc64fb9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1319 microversion: 2.1 time: 0.226535 Feb 28 19:14:02.765376 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 439/882] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:14:02 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:14:03.781801 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f61cc6cf-36f2-423a-88d4-7f842316732a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:14:03.782412 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f61cc6cf-36f2-423a-88d4-7f842316732a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:14:03.790386 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f61cc6cf-36f2-423a-88d4-7f842316732a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:03.790831 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f61cc6cf-36f2-423a-88d4-7f842316732a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:03.791671 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f61cc6cf-36f2-423a-88d4-7f842316732a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:03.792095 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f61cc6cf-36f2-423a-88d4-7f842316732a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:03.992833 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f61cc6cf-36f2-423a-88d4-7f842316732a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:14:04.001274 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f61cc6cf-36f2-423a-88d4-7f842316732a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1319 microversion: 2.1 time: 0.223221 Feb 28 19:14:04.001842 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 444/883] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:14:03 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:14:05.017539 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-59fd5dd9-273e-4759-9ca8-be8d31093022 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:14:05.018144 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-59fd5dd9-273e-4759-9ca8-be8d31093022 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:14:05.025832 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-59fd5dd9-273e-4759-9ca8-be8d31093022 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:05.026273 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-59fd5dd9-273e-4759-9ca8-be8d31093022 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:05.027029 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-59fd5dd9-273e-4759-9ca8-be8d31093022 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:05.027492 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-59fd5dd9-273e-4759-9ca8-be8d31093022 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:05.225262 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-59fd5dd9-273e-4759-9ca8-be8d31093022 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:14:05.233272 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-59fd5dd9-273e-4759-9ca8-be8d31093022 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1319 microversion: 2.1 time: 0.219295 Feb 28 19:14:05.233982 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 440/884] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:14:05 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:14:06.250152 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cd425503-e15a-4ecd-911d-2555fec44879 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:14:06.250772 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-cd425503-e15a-4ecd-911d-2555fec44879 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:14:06.259468 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cd425503-e15a-4ecd-911d-2555fec44879 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:06.261566 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cd425503-e15a-4ecd-911d-2555fec44879 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:06.261566 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cd425503-e15a-4ecd-911d-2555fec44879 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:06.261566 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cd425503-e15a-4ecd-911d-2555fec44879 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:06.463231 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-cd425503-e15a-4ecd-911d-2555fec44879 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:14:06.471639 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-cd425503-e15a-4ecd-911d-2555fec44879 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1319 microversion: 2.1 time: 0.225226 Feb 28 19:14:06.472197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 445/885] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:14:06 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:14:07.340057 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-5cde4662-6b62-4ca9-96a3-2e6738386f3e req-788be342-90db-4a3b-acd2-ddefeada797f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba645b2e-2ff8-46d4-8a64-9723a78988e4", "name": "network-vif-plugged", "status": "completed", "tag": "65f2774c-b61c-4e53-91c1-fbb8f22b4299"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:14:07.341622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:14:07.341622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:14:07.350807 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-5cde4662-6b62-4ca9-96a3-2e6738386f3e req-788be342-90db-4a3b-acd2-ddefeada797f service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:07.351278 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-5cde4662-6b62-4ca9-96a3-2e6738386f3e req-788be342-90db-4a3b-acd2-ddefeada797f service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:07.368779 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-5cde4662-6b62-4ca9-96a3-2e6738386f3e req-788be342-90db-4a3b-acd2-ddefeada797f service nova] Creating event network-vif-plugged:65f2774c-b61c-4e53-91c1-fbb8f22b4299 for instance ba645b2e-2ff8-46d4-8a64-9723a78988e4 on hv-cinder-83118 Feb 28 19:14:07.374349 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-5cde4662-6b62-4ca9-96a3-2e6738386f3e req-788be342-90db-4a3b-acd2-ddefeada797f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037708 Feb 28 19:14:07.375101 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 441/886] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:14:07.491993 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b6b981d2-26ff-4085-92b0-12589faec1ca tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:14:07.497267 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b6b981d2-26ff-4085-92b0-12589faec1ca tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:14:07.502708 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6b981d2-26ff-4085-92b0-12589faec1ca tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:07.503737 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6b981d2-26ff-4085-92b0-12589faec1ca tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:07.505971 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6b981d2-26ff-4085-92b0-12589faec1ca tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:07.507052 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b6b981d2-26ff-4085-92b0-12589faec1ca tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:07.726210 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b6b981d2-26ff-4085-92b0-12589faec1ca tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:14:07.735149 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b6b981d2-26ff-4085-92b0-12589faec1ca tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1319 microversion: 2.1 time: 0.248551 Feb 28 19:14:07.735708 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 446/887] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:14:07 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:14:08.753509 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-be432dc6-4e57-433d-9d46-c5fdf89b0303 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:14:08.755657 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-be432dc6-4e57-433d-9d46-c5fdf89b0303 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:14:08.763686 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-be432dc6-4e57-433d-9d46-c5fdf89b0303 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:08.764188 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-be432dc6-4e57-433d-9d46-c5fdf89b0303 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:08.765045 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-be432dc6-4e57-433d-9d46-c5fdf89b0303 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:08.765513 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-be432dc6-4e57-433d-9d46-c5fdf89b0303 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:08.967958 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-be432dc6-4e57-433d-9d46-c5fdf89b0303 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:14:08.979229 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-be432dc6-4e57-433d-9d46-c5fdf89b0303 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1319 microversion: 2.1 time: 0.229757 Feb 28 19:14:08.979825 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 442/888] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:14:08 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:14:09.997314 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-87716400-d55c-4aa8-a85b-b52d5cc84529 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:14:09.997911 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-87716400-d55c-4aa8-a85b-b52d5cc84529 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:14:10.005562 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-87716400-d55c-4aa8-a85b-b52d5cc84529 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:10.006008 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-87716400-d55c-4aa8-a85b-b52d5cc84529 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:10.006781 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-87716400-d55c-4aa8-a85b-b52d5cc84529 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:10.007261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-87716400-d55c-4aa8-a85b-b52d5cc84529 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:10.208991 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-87716400-d55c-4aa8-a85b-b52d5cc84529 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:14:10.217209 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-87716400-d55c-4aa8-a85b-b52d5cc84529 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1508 microversion: 2.1 time: 0.223855 Feb 28 19:14:10.217779 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 447/889] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:14:09 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:14:49.182645 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6f6eebda-4367-40a8-8514-8883431383d5 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e6e1bb9-67f4-49bd-9716-dde53cc572ad", "device": "/dev/sdb"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:14:49.184280 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6f6eebda-4367-40a8-8514-8883431383d5 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:14:49.192724 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6f6eebda-4367-40a8-8514-8883431383d5 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:49.193184 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6f6eebda-4367-40a8-8514-8883431383d5 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:49.193970 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6f6eebda-4367-40a8-8514-8883431383d5 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:14:49.194409 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6f6eebda-4367-40a8-8514-8883431383d5 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:14:50.067162 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6f6eebda-4367-40a8-8514-8883431383d5 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "POST /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888255 Feb 28 19:14:50.067814 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 443/890] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:14:49 2022] POST /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:15:22.144543 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-653f526d-f539-4614-935a-ef50d3851a45 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Action: 'create', calling method: .version_select at 0x7f912e452790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1289578035"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:15:22.166099 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-653f526d-f539-4614-935a-ef50d3851a45 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Getting quotas for project f298627f53d14c5d92595dd3a87578d4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:15:22.169894 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-653f526d-f539-4614-935a-ef50d3851a45 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Getting quotas for user bc3aec60992f441d8f8370f3beafe080 and project f298627f53d14c5d92595dd3a87578d4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:15:22.584779 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-653f526d-f539-4614-935a-ef50d3851a45 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Getting quotas for project f298627f53d14c5d92595dd3a87578d4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:15:22.588584 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-653f526d-f539-4614-935a-ef50d3851a45 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Getting quotas for user bc3aec60992f441d8f8370f3beafe080 and project f298627f53d14c5d92595dd3a87578d4. Resources: {'key_pairs'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:15:22.601562 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-653f526d-f539-4614-935a-ef50d3851a45 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.460863 Feb 28 19:15:22.602205 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 448/891] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Feb 28 19:15:22 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:22.709160 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1006396880", "imageRef": "562c5d62-f6f8-4661-82cb-69337c918f69", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1289578035", "networks": [{"uuid": "dd9fcb5b-3935-4231-a7d4-4a3dfefcfa7a"}]}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:15:22.773529 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.network.neutron [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] validate_networks() for [('dd9fcb5b-3935-4231-a7d4-4a3dfefcfa7a', None, None, None)] {{(pid=101792) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:15:23.500199 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Flavor limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:15:23.500627 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Image limits 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:15:23.501126 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Flavor pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:15:23.501539 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Image pref 0:0:0 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:15:23.501956 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.virt.hardware [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101792) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:15:23.511007 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:23.511500 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:23.512305 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:23.513337 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:23.531153 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Getting quotas for project f298627f53d14c5d92595dd3a87578d4. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:15:23.535103 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Getting quotas for user bc3aec60992f441d8f8370f3beafe080 and project f298627f53d14c5d92595dd3a87578d4. Resources: {'ram', 'instances', 'cores'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:15:23.540432 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7bae5077-c4de-4259-aeff-2b629321620c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:23.541140 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7bae5077-c4de-4259-aeff-2b629321620c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:23.545693 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Going to run 1 instances... {{(pid=101792) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:15:23.548054 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='562c5d62-f6f8-4661-82cb-69337c918f69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101792) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:15:23.548889 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bae5077-c4de-4259-aeff-2b629321620c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:23.549328 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bae5077-c4de-4259-aeff-2b629321620c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:23.550125 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bae5077-c4de-4259-aeff-2b629321620c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:23.550547 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bae5077-c4de-4259-aeff-2b629321620c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:23.660659 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-96816961-f7da-4dd1-b306-126a46ee5c71 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955890 Feb 28 19:15:23.666581 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 444/892] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:15:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 28 19:15:23.671604 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-96d6e262-f17b-41aa-ad4d-298b4196e59d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:23.672335 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-96d6e262-f17b-41aa-ad4d-298b4196e59d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:23.711817 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-7bae5077-c4de-4259-aeff-2b629321620c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lazy-loading 'services' on Instance uuid ba645b2e-2ff8-46d4-8a64-9723a78988e4 {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:15:23.750927 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-96d6e262-f17b-41aa-ad4d-298b4196e59d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:23.759599 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-96d6e262-f17b-41aa-ad4d-298b4196e59d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1259 microversion: 2.1 time: 0.091642 Feb 28 19:15:23.760476 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 445/893] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:23 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1259 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:24.096351 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7bae5077-c4de-4259-aeff-2b629321620c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4/os-volume_attachments/6e6e1bb9-67f4-49bd-9716-dde53cc572ad" status: 202 len: 0 microversion: 2.1 time: 0.559733 Feb 28 19:15:24.097121 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 449/894] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:15:23 2022] DELETE /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4/os-volume_attachments/6e6e1bb9-67f4-49bd-9716-dde53cc572ad => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:15:24.777402 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4e451867-031c-4b7e-99a8-d01f7123b67b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:24.778012 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4e451867-031c-4b7e-99a8-d01f7123b67b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:24.851506 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4e451867-031c-4b7e-99a8-d01f7123b67b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:24.859029 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4e451867-031c-4b7e-99a8-d01f7123b67b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1259 microversion: 2.1 time: 0.085641 Feb 28 19:15:24.859635 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 446/895] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:24 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1259 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:25.877334 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-357ccf9c-1ca1-4622-8ebe-dfa68adbea54 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:25.885664 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-357ccf9c-1ca1-4622-8ebe-dfa68adbea54 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:25.887532 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-357ccf9c-1ca1-4622-8ebe-dfa68adbea54 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:25.888002 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-357ccf9c-1ca1-4622-8ebe-dfa68adbea54 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:25.888799 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-357ccf9c-1ca1-4622-8ebe-dfa68adbea54 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:25.889235 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-357ccf9c-1ca1-4622-8ebe-dfa68adbea54 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:26.009972 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-357ccf9c-1ca1-4622-8ebe-dfa68adbea54 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:26.018028 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-357ccf9c-1ca1-4622-8ebe-dfa68adbea54 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1311 microversion: 2.1 time: 0.145547 Feb 28 19:15:26.018576 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 450/896] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:25 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1311 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:26.369168 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6a2d14a1-b9b4-4af8-918e-91a5551c6f34 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:26.369796 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6a2d14a1-b9b4-4af8-918e-91a5551c6f34 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:26.378363 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6a2d14a1-b9b4-4af8-918e-91a5551c6f34 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:26.378812 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6a2d14a1-b9b4-4af8-918e-91a5551c6f34 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:26.379619 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6a2d14a1-b9b4-4af8-918e-91a5551c6f34 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:26.380058 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6a2d14a1-b9b4-4af8-918e-91a5551c6f34 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:26.442180 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6a2d14a1-b9b4-4af8-918e-91a5551c6f34 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Going to try to terminate instance {{(pid=101792) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:15:26.854170 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6a2d14a1-b9b4-4af8-918e-91a5551c6f34 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 204 len: 0 microversion: 2.1 time: 0.489610 Feb 28 19:15:26.855080 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 447/897] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:15:26 2022] DELETE /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:15:26.866272 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c6131c54-85bb-4ab2-b8fc-2f2dc7e439d7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:26.866272 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c6131c54-85bb-4ab2-b8fc-2f2dc7e439d7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:26.873988 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c6131c54-85bb-4ab2-b8fc-2f2dc7e439d7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:26.874431 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c6131c54-85bb-4ab2-b8fc-2f2dc7e439d7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:26.875468 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c6131c54-85bb-4ab2-b8fc-2f2dc7e439d7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:26.875900 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c6131c54-85bb-4ab2-b8fc-2f2dc7e439d7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:27.036459 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6112ae85-f045-4d55-86ac-066381f2d2c1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:27.036820 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6112ae85-f045-4d55-86ac-066381f2d2c1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:27.045014 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6112ae85-f045-4d55-86ac-066381f2d2c1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:27.050532 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6112ae85-f045-4d55-86ac-066381f2d2c1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:27.050532 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6112ae85-f045-4d55-86ac-066381f2d2c1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:27.050532 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6112ae85-f045-4d55-86ac-066381f2d2c1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:27.107066 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c6131c54-85bb-4ab2-b8fc-2f2dc7e439d7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:27.117742 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c6131c54-85bb-4ab2-b8fc-2f2dc7e439d7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.258180 Feb 28 19:15:27.118459 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 451/898] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:26 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:27.192645 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6112ae85-f045-4d55-86ac-066381f2d2c1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:27.201515 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6112ae85-f045-4d55-86ac-066381f2d2c1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1329 microversion: 2.1 time: 0.169404 Feb 28 19:15:27.202021 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 448/899] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:27 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1329 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:15:28.135709 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d96d8475-242d-46ad-9885-d351e8481ebd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:28.136450 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d96d8475-242d-46ad-9885-d351e8481ebd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:28.144089 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d96d8475-242d-46ad-9885-d351e8481ebd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:28.144532 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d96d8475-242d-46ad-9885-d351e8481ebd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:28.145302 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d96d8475-242d-46ad-9885-d351e8481ebd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:28.145731 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d96d8475-242d-46ad-9885-d351e8481ebd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:28.219339 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c734c6ef-b9e0-47c1-9cdc-6d66a1e75081 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:28.220024 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c734c6ef-b9e0-47c1-9cdc-6d66a1e75081 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:28.227715 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c734c6ef-b9e0-47c1-9cdc-6d66a1e75081 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:28.231047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c734c6ef-b9e0-47c1-9cdc-6d66a1e75081 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:28.231047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c734c6ef-b9e0-47c1-9cdc-6d66a1e75081 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:28.231047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c734c6ef-b9e0-47c1-9cdc-6d66a1e75081 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:28.402812 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d96d8475-242d-46ad-9885-d351e8481ebd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:28.415801 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d96d8475-242d-46ad-9885-d351e8481ebd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.284532 Feb 28 19:15:28.417795 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 452/900] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:28 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:28.661116 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c734c6ef-b9e0-47c1-9cdc-6d66a1e75081 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:28.669877 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c734c6ef-b9e0-47c1-9cdc-6d66a1e75081 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.454163 Feb 28 19:15:28.670793 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 449/901] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:28 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:15:29.433796 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a135c618-b753-4723-9309-7e13f2640916 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:29.435518 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a135c618-b753-4723-9309-7e13f2640916 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:29.444687 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a135c618-b753-4723-9309-7e13f2640916 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:29.445606 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a135c618-b753-4723-9309-7e13f2640916 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:29.446463 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a135c618-b753-4723-9309-7e13f2640916 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:29.447190 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a135c618-b753-4723-9309-7e13f2640916 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:29.663768 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a135c618-b753-4723-9309-7e13f2640916 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:29.673565 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a135c618-b753-4723-9309-7e13f2640916 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.243535 Feb 28 19:15:29.683976 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 453/902] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:29 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:29.688264 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2aedff49-901f-4c03-9f09-ed6d923ef23c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:29.688881 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2aedff49-901f-4c03-9f09-ed6d923ef23c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:29.697349 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aedff49-901f-4c03-9f09-ed6d923ef23c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:29.697801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aedff49-901f-4c03-9f09-ed6d923ef23c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:29.698607 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aedff49-901f-4c03-9f09-ed6d923ef23c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:29.699041 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aedff49-901f-4c03-9f09-ed6d923ef23c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:29.915000 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2aedff49-901f-4c03-9f09-ed6d923ef23c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:29.923674 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2aedff49-901f-4c03-9f09-ed6d923ef23c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.239065 Feb 28 19:15:29.924246 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 450/903] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:29 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:15:30.690403 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-fedd790b-a4bd-4462-9829-032ab0ad4323 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:30.706788 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-fedd790b-a4bd-4462-9829-032ab0ad4323 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:30.706788 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fedd790b-a4bd-4462-9829-032ab0ad4323 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:30.706788 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fedd790b-a4bd-4462-9829-032ab0ad4323 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:30.706788 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fedd790b-a4bd-4462-9829-032ab0ad4323 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:30.707207 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fedd790b-a4bd-4462-9829-032ab0ad4323 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:30.900918 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-fedd790b-a4bd-4462-9829-032ab0ad4323 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:30.909182 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-fedd790b-a4bd-4462-9829-032ab0ad4323 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.222421 Feb 28 19:15:30.909736 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 454/904] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:30 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:30.941346 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-992ad314-a3bc-4f3a-9b92-70ab004dd32d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:30.941893 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-992ad314-a3bc-4f3a-9b92-70ab004dd32d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:30.950460 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-992ad314-a3bc-4f3a-9b92-70ab004dd32d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:30.950919 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-992ad314-a3bc-4f3a-9b92-70ab004dd32d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:30.951904 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-992ad314-a3bc-4f3a-9b92-70ab004dd32d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:30.952343 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-992ad314-a3bc-4f3a-9b92-70ab004dd32d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:31.175163 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-992ad314-a3bc-4f3a-9b92-70ab004dd32d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:31.183872 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-992ad314-a3bc-4f3a-9b92-70ab004dd32d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.246156 Feb 28 19:15:31.184449 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 451/905] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:30 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:31.927356 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ab20fda3-6c5e-47e4-b518-91c0ed3315f9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:31.928790 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ab20fda3-6c5e-47e4-b518-91c0ed3315f9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:31.936919 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ab20fda3-6c5e-47e4-b518-91c0ed3315f9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:31.937370 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ab20fda3-6c5e-47e4-b518-91c0ed3315f9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:31.938314 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ab20fda3-6c5e-47e4-b518-91c0ed3315f9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:31.938862 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ab20fda3-6c5e-47e4-b518-91c0ed3315f9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:32.168840 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ab20fda3-6c5e-47e4-b518-91c0ed3315f9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:32.177094 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ab20fda3-6c5e-47e4-b518-91c0ed3315f9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.253713 Feb 28 19:15:32.177881 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 455/906] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:31 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:32.201633 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b11d8cb0-2e15-4bf3-8a65-8bacc6bf392a tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:32.202871 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b11d8cb0-2e15-4bf3-8a65-8bacc6bf392a tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:32.210612 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b11d8cb0-2e15-4bf3-8a65-8bacc6bf392a tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:32.211011 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b11d8cb0-2e15-4bf3-8a65-8bacc6bf392a tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:32.211815 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b11d8cb0-2e15-4bf3-8a65-8bacc6bf392a tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:32.212245 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b11d8cb0-2e15-4bf3-8a65-8bacc6bf392a tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:32.413925 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b11d8cb0-2e15-4bf3-8a65-8bacc6bf392a tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:32.422869 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b11d8cb0-2e15-4bf3-8a65-8bacc6bf392a tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.225791 Feb 28 19:15:32.423701 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 452/907] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:32 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:33.195463 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-56659c91-ab07-4a83-8708-f8cb9b2784cd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:33.196208 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-56659c91-ab07-4a83-8708-f8cb9b2784cd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:33.203746 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56659c91-ab07-4a83-8708-f8cb9b2784cd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:33.204205 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56659c91-ab07-4a83-8708-f8cb9b2784cd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:33.205162 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56659c91-ab07-4a83-8708-f8cb9b2784cd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:33.206060 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-56659c91-ab07-4a83-8708-f8cb9b2784cd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:33.410372 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-56659c91-ab07-4a83-8708-f8cb9b2784cd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:33.418773 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-56659c91-ab07-4a83-8708-f8cb9b2784cd tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.227746 Feb 28 19:15:33.419367 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 456/908] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:33 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:33.440016 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-93d81aea-0443-4e95-bfa4-d7dcc345cece tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:33.440626 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-93d81aea-0443-4e95-bfa4-d7dcc345cece tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:33.450405 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-93d81aea-0443-4e95-bfa4-d7dcc345cece tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:33.450860 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-93d81aea-0443-4e95-bfa4-d7dcc345cece tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:33.451676 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-93d81aea-0443-4e95-bfa4-d7dcc345cece tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:33.452196 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-93d81aea-0443-4e95-bfa4-d7dcc345cece tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:33.662828 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-93d81aea-0443-4e95-bfa4-d7dcc345cece tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:33.671015 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-93d81aea-0443-4e95-bfa4-d7dcc345cece tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.234658 Feb 28 19:15:33.671617 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 453/909] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:33 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:34.436777 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f82eb250-b5c1-42d9-95ff-df7fdf8259c9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:34.437498 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f82eb250-b5c1-42d9-95ff-df7fdf8259c9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:34.446643 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f82eb250-b5c1-42d9-95ff-df7fdf8259c9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:34.447326 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f82eb250-b5c1-42d9-95ff-df7fdf8259c9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:34.448396 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f82eb250-b5c1-42d9-95ff-df7fdf8259c9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:34.449029 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f82eb250-b5c1-42d9-95ff-df7fdf8259c9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:34.669577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f82eb250-b5c1-42d9-95ff-df7fdf8259c9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:34.678438 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f82eb250-b5c1-42d9-95ff-df7fdf8259c9 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.244863 Feb 28 19:15:34.679329 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 457/910] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:34 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:34.689143 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a7b429fa-f815-4a67-8fa5-39aaaf3949d0 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:34.689696 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a7b429fa-f815-4a67-8fa5-39aaaf3949d0 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:34.697821 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7b429fa-f815-4a67-8fa5-39aaaf3949d0 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:34.698262 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7b429fa-f815-4a67-8fa5-39aaaf3949d0 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:34.699022 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7b429fa-f815-4a67-8fa5-39aaaf3949d0 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:34.699477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a7b429fa-f815-4a67-8fa5-39aaaf3949d0 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:34.991637 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a7b429fa-f815-4a67-8fa5-39aaaf3949d0 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:35.000262 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a7b429fa-f815-4a67-8fa5-39aaaf3949d0 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.315643 Feb 28 19:15:35.001047 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 454/911] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:34 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:35.695128 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c52c6028-cbbc-4e52-b0aa-e7af0313ee5f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:35.695779 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c52c6028-cbbc-4e52-b0aa-e7af0313ee5f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:35.703154 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c52c6028-cbbc-4e52-b0aa-e7af0313ee5f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:35.703630 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c52c6028-cbbc-4e52-b0aa-e7af0313ee5f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:35.704402 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c52c6028-cbbc-4e52-b0aa-e7af0313ee5f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:35.704835 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c52c6028-cbbc-4e52-b0aa-e7af0313ee5f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:35.908799 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c52c6028-cbbc-4e52-b0aa-e7af0313ee5f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:35.919734 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c52c6028-cbbc-4e52-b0aa-e7af0313ee5f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.228525 Feb 28 19:15:35.920415 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 458/912] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:35 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:36.017643 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b4793779-c522-4b93-8816-50318a2b4b80 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:36.018235 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b4793779-c522-4b93-8816-50318a2b4b80 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:36.026267 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b4793779-c522-4b93-8816-50318a2b4b80 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:36.026717 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b4793779-c522-4b93-8816-50318a2b4b80 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:36.027512 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b4793779-c522-4b93-8816-50318a2b4b80 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:36.027950 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b4793779-c522-4b93-8816-50318a2b4b80 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:36.232334 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b4793779-c522-4b93-8816-50318a2b4b80 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:36.241031 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b4793779-c522-4b93-8816-50318a2b4b80 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.227082 Feb 28 19:15:36.241881 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 455/913] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:36 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:36.937905 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-3b897ed6-0719-4974-8604-9fac2597155a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:36.939428 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-3b897ed6-0719-4974-8604-9fac2597155a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:36.948553 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3b897ed6-0719-4974-8604-9fac2597155a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:36.948990 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3b897ed6-0719-4974-8604-9fac2597155a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:36.949775 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3b897ed6-0719-4974-8604-9fac2597155a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:36.950218 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3b897ed6-0719-4974-8604-9fac2597155a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:37.159103 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-3b897ed6-0719-4974-8604-9fac2597155a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:37.167638 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-3b897ed6-0719-4974-8604-9fac2597155a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.234699 Feb 28 19:15:37.172474 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 459/914] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:36 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:37.258238 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-18cdbf3f-b135-47ef-9752-1b6b6c132331 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:37.258817 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-18cdbf3f-b135-47ef-9752-1b6b6c132331 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:37.267055 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18cdbf3f-b135-47ef-9752-1b6b6c132331 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:37.267542 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18cdbf3f-b135-47ef-9752-1b6b6c132331 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:37.268326 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18cdbf3f-b135-47ef-9752-1b6b6c132331 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:37.268758 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-18cdbf3f-b135-47ef-9752-1b6b6c132331 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:37.629096 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-18cdbf3f-b135-47ef-9752-1b6b6c132331 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:37.637314 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-18cdbf3f-b135-47ef-9752-1b6b6c132331 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.383404 Feb 28 19:15:37.637865 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 456/915] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:37 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:38.186292 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-eb61bae1-3c88-4311-a9f8-992f98ce1df3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:38.187833 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-eb61bae1-3c88-4311-a9f8-992f98ce1df3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:38.195853 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eb61bae1-3c88-4311-a9f8-992f98ce1df3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:38.197925 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eb61bae1-3c88-4311-a9f8-992f98ce1df3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:38.197925 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eb61bae1-3c88-4311-a9f8-992f98ce1df3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:38.197925 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-eb61bae1-3c88-4311-a9f8-992f98ce1df3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:38.422882 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-eb61bae1-3c88-4311-a9f8-992f98ce1df3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:38.431854 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-eb61bae1-3c88-4311-a9f8-992f98ce1df3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.250387 Feb 28 19:15:38.497109 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 460/916] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:38 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:38.653854 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8cc9eebd-8083-483b-b818-2c19b4b7ef3f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:38.654427 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8cc9eebd-8083-483b-b818-2c19b4b7ef3f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:38.661776 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8cc9eebd-8083-483b-b818-2c19b4b7ef3f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:38.662920 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8cc9eebd-8083-483b-b818-2c19b4b7ef3f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:38.663750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8cc9eebd-8083-483b-b818-2c19b4b7ef3f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:38.664202 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8cc9eebd-8083-483b-b818-2c19b4b7ef3f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:38.879336 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8cc9eebd-8083-483b-b818-2c19b4b7ef3f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:38.888236 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8cc9eebd-8083-483b-b818-2c19b4b7ef3f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.237979 Feb 28 19:15:38.895557 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 457/917] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:38 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:39.512455 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7838b457-069a-4ff9-8d52-fa5013d58425 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:39.513081 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7838b457-069a-4ff9-8d52-fa5013d58425 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:39.520410 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7838b457-069a-4ff9-8d52-fa5013d58425 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:39.520855 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7838b457-069a-4ff9-8d52-fa5013d58425 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:39.523823 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7838b457-069a-4ff9-8d52-fa5013d58425 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:39.524272 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7838b457-069a-4ff9-8d52-fa5013d58425 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:39.721139 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7838b457-069a-4ff9-8d52-fa5013d58425 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:39.731360 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7838b457-069a-4ff9-8d52-fa5013d58425 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.222584 Feb 28 19:15:39.731921 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 461/918] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:39 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:39.905445 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2e3dadbc-6b0b-427f-8af9-0baaf5d08554 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:39.906056 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2e3dadbc-6b0b-427f-8af9-0baaf5d08554 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:39.913254 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e3dadbc-6b0b-427f-8af9-0baaf5d08554 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:39.913700 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e3dadbc-6b0b-427f-8af9-0baaf5d08554 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:39.914469 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e3dadbc-6b0b-427f-8af9-0baaf5d08554 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:39.914904 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e3dadbc-6b0b-427f-8af9-0baaf5d08554 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:40.111502 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2e3dadbc-6b0b-427f-8af9-0baaf5d08554 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:40.119651 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2e3dadbc-6b0b-427f-8af9-0baaf5d08554 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.217849 Feb 28 19:15:40.120215 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 458/919] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:39 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:40.748336 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4bba65fc-9dc1-4b17-a6fc-6d72c69fc992 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:40.748944 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4bba65fc-9dc1-4b17-a6fc-6d72c69fc992 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:40.756117 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4bba65fc-9dc1-4b17-a6fc-6d72c69fc992 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:40.756561 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4bba65fc-9dc1-4b17-a6fc-6d72c69fc992 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:40.757350 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4bba65fc-9dc1-4b17-a6fc-6d72c69fc992 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:40.757785 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4bba65fc-9dc1-4b17-a6fc-6d72c69fc992 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:40.963097 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4bba65fc-9dc1-4b17-a6fc-6d72c69fc992 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:40.969294 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4bba65fc-9dc1-4b17-a6fc-6d72c69fc992 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.224771 Feb 28 19:15:40.969934 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 462/920] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:40 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:41.136369 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-17d91a64-83ea-4d20-b874-f82252359321 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:41.136936 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-17d91a64-83ea-4d20-b874-f82252359321 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:41.144307 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-17d91a64-83ea-4d20-b874-f82252359321 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:41.144762 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-17d91a64-83ea-4d20-b874-f82252359321 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:41.145537 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-17d91a64-83ea-4d20-b874-f82252359321 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:41.145979 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-17d91a64-83ea-4d20-b874-f82252359321 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:41.347052 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-17d91a64-83ea-4d20-b874-f82252359321 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:41.358133 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-17d91a64-83ea-4d20-b874-f82252359321 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.225473 Feb 28 19:15:41.358688 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 459/921] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:41 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:41.987402 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-bdb4eff6-ba0d-49a9-a872-e9cbc249b23c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:41.987945 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-bdb4eff6-ba0d-49a9-a872-e9cbc249b23c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:41.996261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bdb4eff6-ba0d-49a9-a872-e9cbc249b23c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:41.996705 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bdb4eff6-ba0d-49a9-a872-e9cbc249b23c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:41.997465 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bdb4eff6-ba0d-49a9-a872-e9cbc249b23c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:41.997888 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-bdb4eff6-ba0d-49a9-a872-e9cbc249b23c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:42.190893 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-bdb4eff6-ba0d-49a9-a872-e9cbc249b23c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:42.200239 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-bdb4eff6-ba0d-49a9-a872-e9cbc249b23c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.216608 Feb 28 19:15:42.200842 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 463/922] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:41 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:42.375416 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-316e8266-af69-4161-89bc-1afebf7331ed tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:42.376038 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-316e8266-af69-4161-89bc-1afebf7331ed tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:42.383492 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-316e8266-af69-4161-89bc-1afebf7331ed tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:42.383872 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-316e8266-af69-4161-89bc-1afebf7331ed tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:42.384662 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-316e8266-af69-4161-89bc-1afebf7331ed tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:42.385092 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-316e8266-af69-4161-89bc-1afebf7331ed tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:42.749453 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-316e8266-af69-4161-89bc-1afebf7331ed tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:42.758130 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-316e8266-af69-4161-89bc-1afebf7331ed tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.386570 Feb 28 19:15:42.758953 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 460/923] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:42 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:43.217168 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-59741a58-a67a-493d-9f5e-95f2968c10e2 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:43.217842 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-59741a58-a67a-493d-9f5e-95f2968c10e2 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:43.225129 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-59741a58-a67a-493d-9f5e-95f2968c10e2 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:43.225577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-59741a58-a67a-493d-9f5e-95f2968c10e2 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:43.226364 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-59741a58-a67a-493d-9f5e-95f2968c10e2 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:43.226798 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-59741a58-a67a-493d-9f5e-95f2968c10e2 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:43.492835 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-d5fa6c40-fb5a-42ca-bd30-43955cb273b5 req-9a2d80ec-c387-4b97-996f-0be93b718996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8a4f21-71cd-4cd7-97a0-7c534dfa826d", "tag": "ec6aa0eb-a35d-4608-b76a-18b48ca9440f"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:15:43.494408 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:15:43.494408 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:15:43.501617 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-59741a58-a67a-493d-9f5e-95f2968c10e2 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:43.515501 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-d5fa6c40-fb5a-42ca-bd30-43955cb273b5 req-9a2d80ec-c387-4b97-996f-0be93b718996 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:43.515615 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-59741a58-a67a-493d-9f5e-95f2968c10e2 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1514 microversion: 2.1 time: 0.299633 Feb 28 19:15:43.515709 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-d5fa6c40-fb5a-42ca-bd30-43955cb273b5 req-9a2d80ec-c387-4b97-996f-0be93b718996 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:43.515796 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 464/924] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:43 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:43.534685 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-d5fa6c40-fb5a-42ca-bd30-43955cb273b5 req-9a2d80ec-c387-4b97-996f-0be93b718996 service nova] Creating event network-changed:ec6aa0eb-a35d-4608-b76a-18b48ca9440f for instance 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d on hv-cinder-83118 Feb 28 19:15:43.540337 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-d5fa6c40-fb5a-42ca-bd30-43955cb273b5 req-9a2d80ec-c387-4b97-996f-0be93b718996 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051608 Feb 28 19:15:43.540936 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 461/925] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:15:43.775344 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a96800d7-bab7-41fe-8d9c-74ddcefcb92e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:43.776044 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a96800d7-bab7-41fe-8d9c-74ddcefcb92e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:43.783527 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a96800d7-bab7-41fe-8d9c-74ddcefcb92e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:43.784063 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a96800d7-bab7-41fe-8d9c-74ddcefcb92e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:43.784846 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a96800d7-bab7-41fe-8d9c-74ddcefcb92e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:43.785269 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a96800d7-bab7-41fe-8d9c-74ddcefcb92e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:44.101248 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a96800d7-bab7-41fe-8d9c-74ddcefcb92e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:44.109505 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a96800d7-bab7-41fe-8d9c-74ddcefcb92e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.339160 Feb 28 19:15:44.110355 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 465/926] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:43 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:44.532025 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-3396cf1b-d5e6-4b8d-8786-47f131f00ad3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:44.532642 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-3396cf1b-d5e6-4b8d-8786-47f131f00ad3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:44.540057 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3396cf1b-d5e6-4b8d-8786-47f131f00ad3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:44.540494 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3396cf1b-d5e6-4b8d-8786-47f131f00ad3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:44.541296 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3396cf1b-d5e6-4b8d-8786-47f131f00ad3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:44.541703 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-3396cf1b-d5e6-4b8d-8786-47f131f00ad3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:44.678986 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-3396cf1b-d5e6-4b8d-8786-47f131f00ad3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:44.687698 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-3396cf1b-d5e6-4b8d-8786-47f131f00ad3 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1472 microversion: 2.1 time: 0.159951 Feb 28 19:15:44.688260 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 462/927] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:44 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1472 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:44.720313 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-c14e30ef-9bc1-4feb-8909-a08f836db157 req-2df55df8-6bed-4ead-9463-93fd60e01340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba645b2e-2ff8-46d4-8a64-9723a78988e4", "name": "network-vif-deleted", "tag": "65f2774c-b61c-4e53-91c1-fbb8f22b4299"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:15:44.721885 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:15:44.721885 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:15:44.729965 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-c14e30ef-9bc1-4feb-8909-a08f836db157 req-2df55df8-6bed-4ead-9463-93fd60e01340 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:44.730402 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-c14e30ef-9bc1-4feb-8909-a08f836db157 req-2df55df8-6bed-4ead-9463-93fd60e01340 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:44.746082 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-c14e30ef-9bc1-4feb-8909-a08f836db157 req-2df55df8-6bed-4ead-9463-93fd60e01340 service nova] Creating event network-vif-deleted:65f2774c-b61c-4e53-91c1-fbb8f22b4299 for instance ba645b2e-2ff8-46d4-8a64-9723a78988e4 on hv-cinder-83118 Feb 28 19:15:44.750798 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-c14e30ef-9bc1-4feb-8909-a08f836db157 req-2df55df8-6bed-4ead-9463-93fd60e01340 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034111 Feb 28 19:15:44.751418 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 466/928] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:15:45.126428 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b44ec001-9ea6-4b84-a6e2-908ae0cc32e9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:45.126986 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b44ec001-9ea6-4b84-a6e2-908ae0cc32e9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:45.134388 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b44ec001-9ea6-4b84-a6e2-908ae0cc32e9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:45.138717 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b44ec001-9ea6-4b84-a6e2-908ae0cc32e9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:45.138717 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b44ec001-9ea6-4b84-a6e2-908ae0cc32e9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:45.138717 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b44ec001-9ea6-4b84-a6e2-908ae0cc32e9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:45.329556 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b44ec001-9ea6-4b84-a6e2-908ae0cc32e9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:45.337983 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b44ec001-9ea6-4b84-a6e2-908ae0cc32e9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.215283 Feb 28 19:15:45.338537 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 463/929] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:45 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:45.706599 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ceb9fa7c-9c29-447d-94ef-afcbbde7c816 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:45.707326 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ceb9fa7c-9c29-447d-94ef-afcbbde7c816 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:45.715864 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ceb9fa7c-9c29-447d-94ef-afcbbde7c816 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:45.716440 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ceb9fa7c-9c29-447d-94ef-afcbbde7c816 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:45.717234 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ceb9fa7c-9c29-447d-94ef-afcbbde7c816 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:45.717671 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ceb9fa7c-9c29-447d-94ef-afcbbde7c816 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:45.788044 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ceb9fa7c-9c29-447d-94ef-afcbbde7c816 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:45.788689 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ceb9fa7c-9c29-447d-94ef-afcbbde7c816 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:45.788938 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-ceb9fa7c-9c29-447d-94ef-afcbbde7c816 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lazy-loading 'fault' on Instance uuid ba645b2e-2ff8-46d4-8a64-9723a78988e4 {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:15:45.949991 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ceb9fa7c-9c29-447d-94ef-afcbbde7c816 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:45.957557 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ceb9fa7c-9c29-447d-94ef-afcbbde7c816 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 200 len: 1309 microversion: 2.1 time: 0.255173 Feb 28 19:15:45.958120 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 467/930] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:45 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 1309 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:46.354745 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c47eac0a-026b-4551-843f-9f253da951b8 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:46.355389 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c47eac0a-026b-4551-843f-9f253da951b8 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:46.362323 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c47eac0a-026b-4551-843f-9f253da951b8 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:46.362787 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c47eac0a-026b-4551-843f-9f253da951b8 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:46.363561 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c47eac0a-026b-4551-843f-9f253da951b8 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:46.363990 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c47eac0a-026b-4551-843f-9f253da951b8 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:46.566055 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c47eac0a-026b-4551-843f-9f253da951b8 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:46.575206 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c47eac0a-026b-4551-843f-9f253da951b8 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.224192 Feb 28 19:15:46.575763 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 464/931] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:46 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:15:46.975813 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d886dc99-7acf-4344-975a-206f8f1a9012 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:46.976436 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d886dc99-7acf-4344-975a-206f8f1a9012 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: ba645b2e-2ff8-46d4-8a64-9723a78988e4] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:46.983800 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d886dc99-7acf-4344-975a-206f8f1a9012 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:46.984251 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d886dc99-7acf-4344-975a-206f8f1a9012 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:46.985022 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d886dc99-7acf-4344-975a-206f8f1a9012 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:46.985456 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d886dc99-7acf-4344-975a-206f8f1a9012 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:47.033694 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-d886dc99-7acf-4344-975a-206f8f1a9012 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] HTTP exception thrown: Instance ba645b2e-2ff8-46d4-8a64-9723a78988e4 could not be found. Feb 28 19:15:47.034286 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d886dc99-7acf-4344-975a-206f8f1a9012 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Returning 404 to user: Instance ba645b2e-2ff8-46d4-8a64-9723a78988e4 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:15:47.035098 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d886dc99-7acf-4344-975a-206f8f1a9012 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4" status: 404 len: 111 microversion: 2.1 time: 0.063752 Feb 28 19:15:47.035662 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 468/932] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:46 2022] GET /compute/v2.1/servers/ba645b2e-2ff8-46d4-8a64-9723a78988e4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:15:47.592349 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-dd2acde7-5969-4f1a-ac90-2eb79eb7d529 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:47.592877 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-dd2acde7-5969-4f1a-ac90-2eb79eb7d529 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:47.601398 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dd2acde7-5969-4f1a-ac90-2eb79eb7d529 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:47.606586 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dd2acde7-5969-4f1a-ac90-2eb79eb7d529 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:47.606586 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dd2acde7-5969-4f1a-ac90-2eb79eb7d529 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:47.606586 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dd2acde7-5969-4f1a-ac90-2eb79eb7d529 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:47.799954 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dd2acde7-5969-4f1a-ac90-2eb79eb7d529 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:47.808684 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-dd2acde7-5969-4f1a-ac90-2eb79eb7d529 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.220237 Feb 28 19:15:47.809232 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 465/933] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:47 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:48.824786 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-db35fc36-7fcd-489f-874c-d401dbd2a98e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:48.825366 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-db35fc36-7fcd-489f-874c-d401dbd2a98e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:48.832504 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-db35fc36-7fcd-489f-874c-d401dbd2a98e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:48.832944 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-db35fc36-7fcd-489f-874c-d401dbd2a98e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:48.833691 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-db35fc36-7fcd-489f-874c-d401dbd2a98e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:48.834122 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-db35fc36-7fcd-489f-874c-d401dbd2a98e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:49.028957 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-db35fc36-7fcd-489f-874c-d401dbd2a98e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:49.036862 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-db35fc36-7fcd-489f-874c-d401dbd2a98e tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.215829 Feb 28 19:15:49.038019 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 469/934] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:48 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:50.054479 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-81c3d5fd-0565-448f-b6e6-ba178684f86f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:50.055136 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-81c3d5fd-0565-448f-b6e6-ba178684f86f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:50.062333 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-81c3d5fd-0565-448f-b6e6-ba178684f86f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:50.062780 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-81c3d5fd-0565-448f-b6e6-ba178684f86f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:50.063579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-81c3d5fd-0565-448f-b6e6-ba178684f86f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:50.064017 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-81c3d5fd-0565-448f-b6e6-ba178684f86f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:50.263854 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-81c3d5fd-0565-448f-b6e6-ba178684f86f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:50.272190 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-81c3d5fd-0565-448f-b6e6-ba178684f86f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.221685 Feb 28 19:15:50.273010 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 466/935] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:50 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:51.289169 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-9a1608a0-5eec-4ba9-9226-bcc59c805c8d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:51.289771 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-9a1608a0-5eec-4ba9-9226-bcc59c805c8d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:51.296921 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9a1608a0-5eec-4ba9-9226-bcc59c805c8d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:51.297366 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9a1608a0-5eec-4ba9-9226-bcc59c805c8d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:51.298133 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9a1608a0-5eec-4ba9-9226-bcc59c805c8d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:51.298562 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-9a1608a0-5eec-4ba9-9226-bcc59c805c8d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:51.492931 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-9a1608a0-5eec-4ba9-9226-bcc59c805c8d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:51.500881 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-9a1608a0-5eec-4ba9-9226-bcc59c805c8d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.215533 Feb 28 19:15:51.501442 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 470/936] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:51 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:15:52.518051 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4cbeb0b9-40dd-4714-a799-0bea4e838a1c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:52.518664 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4cbeb0b9-40dd-4714-a799-0bea4e838a1c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:52.526819 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4cbeb0b9-40dd-4714-a799-0bea4e838a1c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:52.527296 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4cbeb0b9-40dd-4714-a799-0bea4e838a1c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:52.528060 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4cbeb0b9-40dd-4714-a799-0bea4e838a1c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:52.528492 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4cbeb0b9-40dd-4714-a799-0bea4e838a1c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:52.721672 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4cbeb0b9-40dd-4714-a799-0bea4e838a1c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:52.730568 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4cbeb0b9-40dd-4714-a799-0bea4e838a1c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.216000 Feb 28 19:15:52.731161 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 467/937] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:52 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:53.746356 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-fde2b636-13dc-4217-b3b4-c628cacc3f8c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:53.746963 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-fde2b636-13dc-4217-b3b4-c628cacc3f8c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:53.754116 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fde2b636-13dc-4217-b3b4-c628cacc3f8c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:53.754624 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fde2b636-13dc-4217-b3b4-c628cacc3f8c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:53.755458 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fde2b636-13dc-4217-b3b4-c628cacc3f8c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:53.757088 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-fde2b636-13dc-4217-b3b4-c628cacc3f8c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:53.964750 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-fde2b636-13dc-4217-b3b4-c628cacc3f8c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:53.973212 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-fde2b636-13dc-4217-b3b4-c628cacc3f8c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.230438 Feb 28 19:15:53.974358 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 471/938] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:53 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:54.071628 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-a1d57433-6d2d-4b92-b09a-a140e1ef97a1 req-28b7038a-1997-4f64-b83f-0aedf689761b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8a4f21-71cd-4cd7-97a0-7c534dfa826d", "name": "network-vif-plugged", "status": "completed", "tag": "ec6aa0eb-a35d-4608-b76a-18b48ca9440f"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:15:54.073284 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:15:54.073284 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:15:54.081442 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-a1d57433-6d2d-4b92-b09a-a140e1ef97a1 req-28b7038a-1997-4f64-b83f-0aedf689761b service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:54.081957 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-a1d57433-6d2d-4b92-b09a-a140e1ef97a1 req-28b7038a-1997-4f64-b83f-0aedf689761b service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:54.098335 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-a1d57433-6d2d-4b92-b09a-a140e1ef97a1 req-28b7038a-1997-4f64-b83f-0aedf689761b service nova] Creating event network-vif-plugged:ec6aa0eb-a35d-4608-b76a-18b48ca9440f for instance 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d on hv-cinder-83118 Feb 28 19:15:54.103785 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-a1d57433-6d2d-4b92-b09a-a140e1ef97a1 req-28b7038a-1997-4f64-b83f-0aedf689761b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037832 Feb 28 19:15:54.104367 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 468/939] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:15:54.989585 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ff8351b6-afbd-410a-9c1c-1287d7fc2617 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:54.990203 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ff8351b6-afbd-410a-9c1c-1287d7fc2617 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:54.998217 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff8351b6-afbd-410a-9c1c-1287d7fc2617 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:54.998669 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff8351b6-afbd-410a-9c1c-1287d7fc2617 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:54.999474 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff8351b6-afbd-410a-9c1c-1287d7fc2617 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:54.999914 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff8351b6-afbd-410a-9c1c-1287d7fc2617 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:55.198388 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ff8351b6-afbd-410a-9c1c-1287d7fc2617 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:55.206546 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ff8351b6-afbd-410a-9c1c-1287d7fc2617 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.220685 Feb 28 19:15:55.207134 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 472/940] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:54 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:56.224115 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1bb6bfb9-5cb1-4a1c-9344-d5ce918df442 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:56.224906 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1bb6bfb9-5cb1-4a1c-9344-d5ce918df442 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:56.232445 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1bb6bfb9-5cb1-4a1c-9344-d5ce918df442 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:56.232891 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1bb6bfb9-5cb1-4a1c-9344-d5ce918df442 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:56.233655 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1bb6bfb9-5cb1-4a1c-9344-d5ce918df442 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:56.234090 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1bb6bfb9-5cb1-4a1c-9344-d5ce918df442 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:56.427750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1bb6bfb9-5cb1-4a1c-9344-d5ce918df442 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:56.435879 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1bb6bfb9-5cb1-4a1c-9344-d5ce918df442 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1359 microversion: 2.1 time: 0.216091 Feb 28 19:15:56.441684 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 469/941] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:56 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:57.452721 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-42858d6a-1d56-4384-bd1f-d782264e4619 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:57.453338 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-42858d6a-1d56-4384-bd1f-d782264e4619 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:57.461197 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-42858d6a-1d56-4384-bd1f-d782264e4619 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:57.461647 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-42858d6a-1d56-4384-bd1f-d782264e4619 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:57.462416 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-42858d6a-1d56-4384-bd1f-d782264e4619 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:57.462855 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-42858d6a-1d56-4384-bd1f-d782264e4619 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:57.660039 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-42858d6a-1d56-4384-bd1f-d782264e4619 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:57.668730 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-42858d6a-1d56-4384-bd1f-d782264e4619 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1550 microversion: 2.1 time: 0.219821 Feb 28 19:15:57.669313 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 473/942] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:57 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1550 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:57.684676 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-68963061-3dba-48d6-a5cb-8b01d7ea6e32 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:57.685285 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-68963061-3dba-48d6-a5cb-8b01d7ea6e32 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:57.692382 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-68963061-3dba-48d6-a5cb-8b01d7ea6e32 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:57.692830 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-68963061-3dba-48d6-a5cb-8b01d7ea6e32 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:57.694084 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-68963061-3dba-48d6-a5cb-8b01d7ea6e32 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:57.694689 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-68963061-3dba-48d6-a5cb-8b01d7ea6e32 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:57.886362 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-68963061-3dba-48d6-a5cb-8b01d7ea6e32 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:57.894397 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-68963061-3dba-48d6-a5cb-8b01d7ea6e32 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1550 microversion: 2.1 time: 0.213462 Feb 28 19:15:57.894945 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 470/943] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:57 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1550 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:15:57.910653 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1a84c406-1cd6-4de5-8bbc-0238b43a8ab9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:57.914267 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:15:57.914267 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:15:57.915285 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1a84c406-1cd6-4de5-8bbc-0238b43a8ab9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:57.916051 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1a84c406-1cd6-4de5-8bbc-0238b43a8ab9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Searching by: {'deleted': False, 'project_id': 'f298627f53d14c5d92595dd3a87578d4'} {{(pid=101791) get_all /opt/stack/nova/nova/compute/api.py:2855}} Feb 28 19:15:57.921434 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a84c406-1cd6-4de5-8bbc-0238b43a8ab9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:57.921875 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a84c406-1cd6-4de5-8bbc-0238b43a8ab9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:57.922661 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a84c406-1cd6-4de5-8bbc-0238b43a8ab9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:57.923090 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1a84c406-1cd6-4de5-8bbc-0238b43a8ab9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:58.011916 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.multi_cell_list [None req-1a84c406-1cd6-4de5-8bbc-0238b43a8ab9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=101791) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Feb 28 19:15:58.104186 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1a84c406-1cd6-4de5-8bbc-0238b43a8ab9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197031 Feb 28 19:15:58.104754 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 474/944] 10.222.0.21 () {58 vars in 1124 bytes} [Mon Feb 28 19:15:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:15:58.114506 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-08a6da4d-cbbd-42ce-bcd3-7c0164042c98 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:15:58.115691 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-08a6da4d-cbbd-42ce-bcd3-7c0164042c98 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:15:58.122766 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-08a6da4d-cbbd-42ce-bcd3-7c0164042c98 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:58.123262 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-08a6da4d-cbbd-42ce-bcd3-7c0164042c98 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:58.124020 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-08a6da4d-cbbd-42ce-bcd3-7c0164042c98 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:15:58.124446 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-08a6da4d-cbbd-42ce-bcd3-7c0164042c98 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:15:58.324814 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-08a6da4d-cbbd-42ce-bcd3-7c0164042c98 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:15:58.332989 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-08a6da4d-cbbd-42ce-bcd3-7c0164042c98 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1550 microversion: 2.1 time: 0.222013 Feb 28 19:15:58.333702 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 471/945] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:15:58 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1550 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:02.077324 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1708352886", "imageRef": "b98abc78-7650-4004-b472-6058c1016993", "flavorRef": "452", "networks": [{"uuid": "686c36cb-f669-4810-83b3-a9d37b1a6ff3"}]}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:02.145818 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.network.neutron [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] validate_networks() for [('686c36cb-f669-4810-83b3-a9d37b1a6ff3', None, None, None)] {{(pid=101791) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:16:02.482570 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-de0554a8-e727-4236-8cfd-1f0e2b1b3829 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f29b9dc-e17e-4312-9bfc-3ddd7dc2632b"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:02.483743 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-de0554a8-e727-4236-8cfd-1f0e2b1b3829 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:02.491882 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de0554a8-e727-4236-8cfd-1f0e2b1b3829 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:02.492400 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de0554a8-e727-4236-8cfd-1f0e2b1b3829 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:02.493234 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de0554a8-e727-4236-8cfd-1f0e2b1b3829 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:02.493730 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-de0554a8-e727-4236-8cfd-1f0e2b1b3829 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:02.745041 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Flavor limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:16:02.749589 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Image limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:16:02.749589 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Flavor pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:16:02.749589 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Image pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:16:02.749589 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:16:02.755261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:02.755932 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:02.756835 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:02.757322 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:02.775311 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Getting quotas for project 1c06762c8979480f92330ac600b63c5c. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:16:02.779274 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Getting quotas for user 8668df273a9344938c66d1ee69a42238 and project 1c06762c8979480f92330ac600b63c5c. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:16:02.790322 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Going to run 1 instances... {{(pid=101791) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:16:02.792757 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b98abc78-7650-4004-b472-6058c1016993',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:16:02.960307 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5749f9c7-2f20-4132-bf05-4c06516a4062 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886660 Feb 28 19:16:02.961168 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 475/946] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:16:02.980204 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c2448c8c-e3a9-455f-800f-1b2a6201530c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:02.981068 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c2448c8c-e3a9-455f-800f-1b2a6201530c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:03.057507 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c2448c8c-e3a9-455f-800f-1b2a6201530c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:03.066658 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c2448c8c-e3a9-455f-800f-1b2a6201530c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1219 microversion: 2.1 time: 0.099714 Feb 28 19:16:03.067261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 476/947] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:02 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:16:03.324217 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-de0554a8-e727-4236-8cfd-1f0e2b1b3829 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "POST /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.843850 Feb 28 19:16:03.324217 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 472/948] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:16:02 2022] POST /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments => generated 194 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:16:04.083426 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-ff9a9889-48de-49a6-88b8-55c05b6d170c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:04.084656 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-ff9a9889-48de-49a6-88b8-55c05b6d170c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:04.091990 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff9a9889-48de-49a6-88b8-55c05b6d170c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:04.092435 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff9a9889-48de-49a6-88b8-55c05b6d170c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:04.093201 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff9a9889-48de-49a6-88b8-55c05b6d170c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:04.093629 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-ff9a9889-48de-49a6-88b8-55c05b6d170c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:04.204687 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-ff9a9889-48de-49a6-88b8-55c05b6d170c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:04.213203 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-ff9a9889-48de-49a6-88b8-55c05b6d170c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1223 microversion: 2.1 time: 0.133709 Feb 28 19:16:04.213754 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 477/949] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:04 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:05.231809 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-dbd81c58-907c-4c1e-a968-c8fdbd72dd39 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:05.232432 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-dbd81c58-907c-4c1e-a968-c8fdbd72dd39 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:05.241296 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbd81c58-907c-4c1e-a968-c8fdbd72dd39 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:05.254344 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbd81c58-907c-4c1e-a968-c8fdbd72dd39 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:05.254344 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbd81c58-907c-4c1e-a968-c8fdbd72dd39 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:05.254344 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dbd81c58-907c-4c1e-a968-c8fdbd72dd39 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:05.363242 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dbd81c58-907c-4c1e-a968-c8fdbd72dd39 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:05.373239 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-dbd81c58-907c-4c1e-a968-c8fdbd72dd39 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1289 microversion: 2.1 time: 0.146399 Feb 28 19:16:05.374538 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 473/950] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:05 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1289 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:06.393084 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-639fbe5a-4365-421b-8b7f-c20b885b9371 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:06.393756 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-639fbe5a-4365-421b-8b7f-c20b885b9371 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:06.401545 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-639fbe5a-4365-421b-8b7f-c20b885b9371 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:06.401991 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-639fbe5a-4365-421b-8b7f-c20b885b9371 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:06.402763 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-639fbe5a-4365-421b-8b7f-c20b885b9371 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:06.403228 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-639fbe5a-4365-421b-8b7f-c20b885b9371 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:06.604503 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-639fbe5a-4365-421b-8b7f-c20b885b9371 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:06.616056 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-639fbe5a-4365-421b-8b7f-c20b885b9371 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1319 microversion: 2.1 time: 0.226497 Feb 28 19:16:06.619969 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 478/951] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:06 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:07.289816 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-2fd4b0fd-d2dc-4d4f-8349-09e730bb0475 req-dd75616b-1a37-46e1-916e-3ce723b43118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1630c283-c674-4fb1-be21-7eb220ea227f", "tag": "fb1c6728-f3d8-4fe4-866e-9a1da52cf317"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:07.291398 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:16:07.291398 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:16:07.299827 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-2fd4b0fd-d2dc-4d4f-8349-09e730bb0475 req-dd75616b-1a37-46e1-916e-3ce723b43118 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:07.300266 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-2fd4b0fd-d2dc-4d4f-8349-09e730bb0475 req-dd75616b-1a37-46e1-916e-3ce723b43118 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:07.316743 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-2fd4b0fd-d2dc-4d4f-8349-09e730bb0475 req-dd75616b-1a37-46e1-916e-3ce723b43118 service nova] Creating event network-changed:fb1c6728-f3d8-4fe4-866e-9a1da52cf317 for instance 1630c283-c674-4fb1-be21-7eb220ea227f on hv-cinder-83118 Feb 28 19:16:07.321963 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-2fd4b0fd-d2dc-4d4f-8349-09e730bb0475 req-dd75616b-1a37-46e1-916e-3ce723b43118 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035981 Feb 28 19:16:07.322540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 474/952] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:16:07.633449 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f64ab9f6-3956-4ade-89bc-1f32734bc8fa tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:07.634200 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f64ab9f6-3956-4ade-89bc-1f32734bc8fa tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:07.641386 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f64ab9f6-3956-4ade-89bc-1f32734bc8fa tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:07.641832 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f64ab9f6-3956-4ade-89bc-1f32734bc8fa tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:07.642601 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f64ab9f6-3956-4ade-89bc-1f32734bc8fa tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:07.643032 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f64ab9f6-3956-4ade-89bc-1f32734bc8fa tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:07.863262 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f64ab9f6-3956-4ade-89bc-1f32734bc8fa tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:07.872068 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f64ab9f6-3956-4ade-89bc-1f32734bc8fa tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1319 microversion: 2.1 time: 0.242791 Feb 28 19:16:07.872736 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 479/953] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:07 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:08.889638 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-dcc383db-85c8-46a7-a9f0-8ac80c1879f7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:08.890334 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-dcc383db-85c8-46a7-a9f0-8ac80c1879f7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:08.898941 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dcc383db-85c8-46a7-a9f0-8ac80c1879f7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:08.899416 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dcc383db-85c8-46a7-a9f0-8ac80c1879f7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:08.900183 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dcc383db-85c8-46a7-a9f0-8ac80c1879f7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:08.900617 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-dcc383db-85c8-46a7-a9f0-8ac80c1879f7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:09.192749 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-dcc383db-85c8-46a7-a9f0-8ac80c1879f7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:09.201238 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-dcc383db-85c8-46a7-a9f0-8ac80c1879f7 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1319 microversion: 2.1 time: 0.315641 Feb 28 19:16:09.201784 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 475/954] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:08 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:10.215605 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: ERROR oslo.messaging._drivers.impl_rabbit [-] [295cd133-f5a7-4657-b76e-4933c04695f5] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 28 19:16:10.218806 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-147fab10-cd8e-4aa1-a7dd-4ece7a9db4d4 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:10.219444 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-147fab10-cd8e-4aa1-a7dd-4ece7a9db4d4 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:10.226708 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-147fab10-cd8e-4aa1-a7dd-4ece7a9db4d4 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:10.227196 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-147fab10-cd8e-4aa1-a7dd-4ece7a9db4d4 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:10.227961 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-147fab10-cd8e-4aa1-a7dd-4ece7a9db4d4 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:10.228395 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-147fab10-cd8e-4aa1-a7dd-4ece7a9db4d4 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:10.428155 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-147fab10-cd8e-4aa1-a7dd-4ece7a9db4d4 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:10.436180 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-147fab10-cd8e-4aa1-a7dd-4ece7a9db4d4 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1319 microversion: 2.1 time: 0.222187 Feb 28 19:16:10.436738 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 480/955] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:10 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:11.453191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-724bf70c-05ff-4d40-a691-0be6e55ab77a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:11.453850 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-724bf70c-05ff-4d40-a691-0be6e55ab77a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:11.462300 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-724bf70c-05ff-4d40-a691-0be6e55ab77a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:11.462747 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-724bf70c-05ff-4d40-a691-0be6e55ab77a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:11.463540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-724bf70c-05ff-4d40-a691-0be6e55ab77a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:11.463974 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-724bf70c-05ff-4d40-a691-0be6e55ab77a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:11.656669 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-724bf70c-05ff-4d40-a691-0be6e55ab77a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:11.664851 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-724bf70c-05ff-4d40-a691-0be6e55ab77a tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1319 microversion: 2.1 time: 0.215405 Feb 28 19:16:11.665402 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 476/956] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:11 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:12.422749 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b296544c-219c-4bd8-88ca-a5d7a5b34c97 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:12.423415 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b296544c-219c-4bd8-88ca-a5d7a5b34c97 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:12.431613 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b296544c-219c-4bd8-88ca-a5d7a5b34c97 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:12.432059 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b296544c-219c-4bd8-88ca-a5d7a5b34c97 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:12.432830 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b296544c-219c-4bd8-88ca-a5d7a5b34c97 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:12.433261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b296544c-219c-4bd8-88ca-a5d7a5b34c97 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:12.469535 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] [295cd133-f5a7-4657-b76e-4933c04695f5] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 38444. Feb 28 19:16:12.628401 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b296544c-219c-4bd8-88ca-a5d7a5b34c97 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:12.637545 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b296544c-219c-4bd8-88ca-a5d7a5b34c97 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1596 microversion: 2.1 time: 0.218426 Feb 28 19:16:12.638115 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 481/957] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:12 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1596 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:12.681038 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2aa12685-f5ea-4100-93a9-6e1252f6c607 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:12.681947 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2aa12685-f5ea-4100-93a9-6e1252f6c607 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:12.689758 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aa12685-f5ea-4100-93a9-6e1252f6c607 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:12.690608 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aa12685-f5ea-4100-93a9-6e1252f6c607 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:12.690962 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aa12685-f5ea-4100-93a9-6e1252f6c607 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:12.691420 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aa12685-f5ea-4100-93a9-6e1252f6c607 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:12.899000 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2aa12685-f5ea-4100-93a9-6e1252f6c607 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:12.907179 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2aa12685-f5ea-4100-93a9-6e1252f6c607 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1319 microversion: 2.1 time: 0.229668 Feb 28 19:16:12.908734 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 477/958] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:12 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:13.924338 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-0dd10361-c84d-417b-8394-8671f474ce62 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:13.925669 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-0dd10361-c84d-417b-8394-8671f474ce62 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:13.956531 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0dd10361-c84d-417b-8394-8671f474ce62 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:13.957267 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0dd10361-c84d-417b-8394-8671f474ce62 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:13.958081 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0dd10361-c84d-417b-8394-8671f474ce62 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:13.959066 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-0dd10361-c84d-417b-8394-8671f474ce62 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:14.170097 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-0dd10361-c84d-417b-8394-8671f474ce62 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:14.178793 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-0dd10361-c84d-417b-8394-8671f474ce62 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1319 microversion: 2.1 time: 0.258317 Feb 28 19:16:14.184496 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 482/959] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:13 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:14.277661 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-53c75435-3496-40bf-807a-03eb9633b371 req-2b036a90-640f-40c1-8bfa-07b97d1a3ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1630c283-c674-4fb1-be21-7eb220ea227f", "name": "network-vif-plugged", "status": "completed", "tag": "fb1c6728-f3d8-4fe4-866e-9a1da52cf317"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:14.279221 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:16:14.279221 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:16:14.287455 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-53c75435-3496-40bf-807a-03eb9633b371 req-2b036a90-640f-40c1-8bfa-07b97d1a3ef7 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:14.287890 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-53c75435-3496-40bf-807a-03eb9633b371 req-2b036a90-640f-40c1-8bfa-07b97d1a3ef7 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:14.303461 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-53c75435-3496-40bf-807a-03eb9633b371 req-2b036a90-640f-40c1-8bfa-07b97d1a3ef7 service nova] Creating event network-vif-plugged:fb1c6728-f3d8-4fe4-866e-9a1da52cf317 for instance 1630c283-c674-4fb1-be21-7eb220ea227f on hv-cinder-83118 Feb 28 19:16:14.308167 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-53c75435-3496-40bf-807a-03eb9633b371 req-2b036a90-640f-40c1-8bfa-07b97d1a3ef7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034091 Feb 28 19:16:14.308745 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 478/960] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:16:15.195610 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-1db26d68-7dec-443e-8a6d-8697fe52f468 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:15.196236 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-1db26d68-7dec-443e-8a6d-8697fe52f468 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:15.204272 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1db26d68-7dec-443e-8a6d-8697fe52f468 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:15.204720 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1db26d68-7dec-443e-8a6d-8697fe52f468 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:15.205508 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1db26d68-7dec-443e-8a6d-8697fe52f468 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:15.205939 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-1db26d68-7dec-443e-8a6d-8697fe52f468 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:15.407064 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-1db26d68-7dec-443e-8a6d-8697fe52f468 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:15.415928 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-1db26d68-7dec-443e-8a6d-8697fe52f468 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1319 microversion: 2.1 time: 0.224200 Feb 28 19:16:15.416501 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 483/961] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:15 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:15.587720 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-c4a8e624-551f-4f69-93c2-953a6390489a req-0d9c25a4-2a62-4ac2-a53a-9867c27bb3de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8a4f21-71cd-4cd7-97a0-7c534dfa826d", "tag": "ec6aa0eb-a35d-4608-b76a-18b48ca9440f"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:15.589196 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:16:15.589196 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:16:15.597689 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-c4a8e624-551f-4f69-93c2-953a6390489a req-0d9c25a4-2a62-4ac2-a53a-9867c27bb3de service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:15.598344 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-c4a8e624-551f-4f69-93c2-953a6390489a req-0d9c25a4-2a62-4ac2-a53a-9867c27bb3de service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:15.616569 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-c4a8e624-551f-4f69-93c2-953a6390489a req-0d9c25a4-2a62-4ac2-a53a-9867c27bb3de service nova] Creating event network-changed:ec6aa0eb-a35d-4608-b76a-18b48ca9440f for instance 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d on hv-cinder-83118 Feb 28 19:16:15.621280 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-c4a8e624-551f-4f69-93c2-953a6390489a req-0d9c25a4-2a62-4ac2-a53a-9867c27bb3de service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038343 Feb 28 19:16:15.622814 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 479/962] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:16:16.433314 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-61b2b3ba-ff6b-4c1a-8f00-4a5f87633e0d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:16.433939 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-61b2b3ba-ff6b-4c1a-8f00-4a5f87633e0d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:16.441770 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-61b2b3ba-ff6b-4c1a-8f00-4a5f87633e0d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:16.448235 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-61b2b3ba-ff6b-4c1a-8f00-4a5f87633e0d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:16.448235 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-61b2b3ba-ff6b-4c1a-8f00-4a5f87633e0d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:16.448235 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-61b2b3ba-ff6b-4c1a-8f00-4a5f87633e0d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:16.695939 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-61b2b3ba-ff6b-4c1a-8f00-4a5f87633e0d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:16.706450 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-61b2b3ba-ff6b-4c1a-8f00-4a5f87633e0d tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1319 microversion: 2.1 time: 0.274908 Feb 28 19:16:16.706450 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 484/963] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:16 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:17.721146 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7daabd25-7ba0-46af-a7e3-5e3f3edd3e1f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:17.721883 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7daabd25-7ba0-46af-a7e3-5e3f3edd3e1f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:17.729559 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7daabd25-7ba0-46af-a7e3-5e3f3edd3e1f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:17.730006 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7daabd25-7ba0-46af-a7e3-5e3f3edd3e1f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:17.735795 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7daabd25-7ba0-46af-a7e3-5e3f3edd3e1f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:17.735795 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7daabd25-7ba0-46af-a7e3-5e3f3edd3e1f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:17.963408 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7daabd25-7ba0-46af-a7e3-5e3f3edd3e1f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:17.971934 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7daabd25-7ba0-46af-a7e3-5e3f3edd3e1f tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1508 microversion: 2.1 time: 0.254706 Feb 28 19:16:17.972589 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 480/964] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:17 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:17.988386 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-18fe3ddb-744c-49fa-bc3f-132e480eb95e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c690ea90-25de-4fb0-8920-9858d515ddbf", "device": "/dev/sdb"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:17.991500 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-18fe3ddb-744c-49fa-bc3f-132e480eb95e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:17.998966 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-18fe3ddb-744c-49fa-bc3f-132e480eb95e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:17.999463 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-18fe3ddb-744c-49fa-bc3f-132e480eb95e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:18.000295 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-18fe3ddb-744c-49fa-bc3f-132e480eb95e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:18.000738 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-18fe3ddb-744c-49fa-bc3f-132e480eb95e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:18.230698 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-96b4681d-12b6-45bf-af79-afe7421f98a5 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1618219625"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:18.231313 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-96b4681d-12b6-45bf-af79-afe7421f98a5 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:18.238539 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96b4681d-12b6-45bf-af79-afe7421f98a5 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:18.238979 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96b4681d-12b6-45bf-af79-afe7421f98a5 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:18.240469 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96b4681d-12b6-45bf-af79-afe7421f98a5 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:18.240926 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96b4681d-12b6-45bf-af79-afe7421f98a5 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:18.508337 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.network.security_group_api [None req-96b4681d-12b6-45bf-af79-afe7421f98a5 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Adding security group c2764f85-2f5b-4747-a36b-46a97d4d0b6a to port ec6aa0eb-a35d-4608-b76a-18b48ca9440f Feb 28 19:16:19.003151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-18fe3ddb-744c-49fa-bc3f-132e480eb95e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "POST /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.018301 Feb 28 19:16:19.003836 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 485/965] 10.222.0.21 () {60 vars in 1322 bytes} [Mon Feb 28 19:16:17 2022] POST /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f/os-volume_attachments => generated 194 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:16:19.176828 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-96b4681d-12b6-45bf-af79-afe7421f98a5 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "POST /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/action" status: 202 len: 0 microversion: 2.1 time: 0.949735 Feb 28 19:16:19.177545 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 481/966] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:16:18 2022] POST /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/action => generated 0 bytes in 951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 28 19:16:19.186070 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-7bc68555-29d3-4b60-a65c-c21445943155 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:19.186800 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-7bc68555-29d3-4b60-a65c-c21445943155 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:19.200884 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-3c3e80a8-c4e1-4843-aa55-f175c893eb6c req-e43e05e1-8ef5-497b-b6e2-6db25e9e8e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8a4f21-71cd-4cd7-97a0-7c534dfa826d", "tag": "ec6aa0eb-a35d-4608-b76a-18b48ca9440f"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:19.201547 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bc68555-29d3-4b60-a65c-c21445943155 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:19.202462 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:16:19.202462 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:16:19.202930 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bc68555-29d3-4b60-a65c-c21445943155 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:19.204062 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bc68555-29d3-4b60-a65c-c21445943155 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:19.204742 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-7bc68555-29d3-4b60-a65c-c21445943155 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:19.232264 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-3c3e80a8-c4e1-4843-aa55-f175c893eb6c req-e43e05e1-8ef5-497b-b6e2-6db25e9e8e05 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:19.232705 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-3c3e80a8-c4e1-4843-aa55-f175c893eb6c req-e43e05e1-8ef5-497b-b6e2-6db25e9e8e05 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:19.253575 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-3c3e80a8-c4e1-4843-aa55-f175c893eb6c req-e43e05e1-8ef5-497b-b6e2-6db25e9e8e05 service nova] Creating event network-changed:ec6aa0eb-a35d-4608-b76a-18b48ca9440f for instance 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d on hv-cinder-83118 Feb 28 19:16:19.259213 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-3c3e80a8-c4e1-4843-aa55-f175c893eb6c req-e43e05e1-8ef5-497b-b6e2-6db25e9e8e05 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062182 Feb 28 19:16:19.260601 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 482/967] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:16:19.452712 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-7bc68555-29d3-4b60-a65c-c21445943155 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:19.462718 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-7bc68555-29d3-4b60-a65c-c21445943155 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1761 microversion: 2.1 time: 0.280730 Feb 28 19:16:19.463563 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 486/968] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:19 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1761 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:37.061069 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d65da532-582f-4260-8589-dc93e6dad8b2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:37.061658 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d65da532-582f-4260-8589-dc93e6dad8b2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:37.069795 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d65da532-582f-4260-8589-dc93e6dad8b2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:37.070243 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d65da532-582f-4260-8589-dc93e6dad8b2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:37.071016 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d65da532-582f-4260-8589-dc93e6dad8b2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:37.071479 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d65da532-582f-4260-8589-dc93e6dad8b2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:37.073374 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-56a7b4db-3978-4c37-a301-c7880d2e9778 req-7d67ec65-e385-470e-8603-6f5b10c384c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a389097e-88f3-40cf-a37d-8ab80c1aadc5", "tag": "15c20d67-5dfd-43c2-84f1-6f01de9fa67e"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:37.074935 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:16:37.074935 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:16:37.087345 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-56a7b4db-3978-4c37-a301-c7880d2e9778 req-7d67ec65-e385-470e-8603-6f5b10c384c4 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:37.087794 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-56a7b4db-3978-4c37-a301-c7880d2e9778 req-7d67ec65-e385-470e-8603-6f5b10c384c4 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:37.104850 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-56a7b4db-3978-4c37-a301-c7880d2e9778 req-7d67ec65-e385-470e-8603-6f5b10c384c4 service nova] Creating event network-changed:15c20d67-5dfd-43c2-84f1-6f01de9fa67e for instance a389097e-88f3-40cf-a37d-8ab80c1aadc5 on hv-cinder-83118 Feb 28 19:16:37.109942 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-56a7b4db-3978-4c37-a301-c7880d2e9778 req-7d67ec65-e385-470e-8603-6f5b10c384c4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042629 Feb 28 19:16:37.110912 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 487/969] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:16:37.135557 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d65da532-582f-4260-8589-dc93e6dad8b2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Going to try to terminate instance {{(pid=101792) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:16:37.387595 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d65da532-582f-4260-8589-dc93e6dad8b2 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "DELETE /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 204 len: 0 microversion: 2.1 time: 0.331085 Feb 28 19:16:37.388203 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 483/970] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:16:37 2022] DELETE /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:16:37.398331 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5615e2dc-8d62-4bb1-8d77-fb05614590a9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:37.399063 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5615e2dc-8d62-4bb1-8d77-fb05614590a9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:37.407027 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5615e2dc-8d62-4bb1-8d77-fb05614590a9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:37.407548 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5615e2dc-8d62-4bb1-8d77-fb05614590a9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:37.408359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5615e2dc-8d62-4bb1-8d77-fb05614590a9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:37.408791 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5615e2dc-8d62-4bb1-8d77-fb05614590a9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:37.612830 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5615e2dc-8d62-4bb1-8d77-fb05614590a9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:37.621308 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5615e2dc-8d62-4bb1-8d77-fb05614590a9 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1578 microversion: 2.1 time: 0.227852 Feb 28 19:16:37.621873 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 488/971] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:37 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1578 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:38.641756 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2aea2553-ccad-4d52-9235-d91a94fd7063 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:38.643629 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2aea2553-ccad-4d52-9235-d91a94fd7063 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:38.652461 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aea2553-ccad-4d52-9235-d91a94fd7063 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:38.652988 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aea2553-ccad-4d52-9235-d91a94fd7063 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:38.654015 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aea2553-ccad-4d52-9235-d91a94fd7063 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:38.654525 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2aea2553-ccad-4d52-9235-d91a94fd7063 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:38.854058 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2aea2553-ccad-4d52-9235-d91a94fd7063 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:38.863459 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2aea2553-ccad-4d52-9235-d91a94fd7063 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1578 microversion: 2.1 time: 0.225681 Feb 28 19:16:38.864220 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 484/972] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:38 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:39.881093 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-8051e0ae-9aa0-4f6b-b574-d955e0f271ec tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:39.881698 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-8051e0ae-9aa0-4f6b-b574-d955e0f271ec tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:39.889050 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8051e0ae-9aa0-4f6b-b574-d955e0f271ec tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:39.889496 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8051e0ae-9aa0-4f6b-b574-d955e0f271ec tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:39.890260 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8051e0ae-9aa0-4f6b-b574-d955e0f271ec tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:39.890691 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-8051e0ae-9aa0-4f6b-b574-d955e0f271ec tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:40.083827 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-8051e0ae-9aa0-4f6b-b574-d955e0f271ec tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:40.091870 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-8051e0ae-9aa0-4f6b-b574-d955e0f271ec tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1459 microversion: 2.1 time: 0.215188 Feb 28 19:16:40.092424 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 489/973] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:39 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1459 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:41.108605 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d07de1c2-1f1a-496e-8605-acb0ea371fe3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:41.109320 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d07de1c2-1f1a-496e-8605-acb0ea371fe3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:41.117740 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d07de1c2-1f1a-496e-8605-acb0ea371fe3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:41.118185 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d07de1c2-1f1a-496e-8605-acb0ea371fe3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:41.118969 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d07de1c2-1f1a-496e-8605-acb0ea371fe3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:41.119425 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d07de1c2-1f1a-496e-8605-acb0ea371fe3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:41.326546 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d07de1c2-1f1a-496e-8605-acb0ea371fe3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:41.335535 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d07de1c2-1f1a-496e-8605-acb0ea371fe3 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1459 microversion: 2.1 time: 0.230666 Feb 28 19:16:41.336155 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 485/974] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:41 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1459 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:41.480978 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-9a47b31a-38bf-48fc-a423-47b4ae358e85 req-504e708d-59d2-4234-b566-573e46edf4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a389097e-88f3-40cf-a37d-8ab80c1aadc5", "name": "network-vif-deleted", "tag": "15c20d67-5dfd-43c2-84f1-6f01de9fa67e"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:41.482734 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:16:41.482734 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:16:41.493275 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-9a47b31a-38bf-48fc-a423-47b4ae358e85 req-504e708d-59d2-4234-b566-573e46edf4d9 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:41.493724 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-9a47b31a-38bf-48fc-a423-47b4ae358e85 req-504e708d-59d2-4234-b566-573e46edf4d9 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:41.510732 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-9a47b31a-38bf-48fc-a423-47b4ae358e85 req-504e708d-59d2-4234-b566-573e46edf4d9 service nova] Creating event network-vif-deleted:15c20d67-5dfd-43c2-84f1-6f01de9fa67e for instance a389097e-88f3-40cf-a37d-8ab80c1aadc5 on hv-cinder-83118 Feb 28 19:16:41.516285 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-9a47b31a-38bf-48fc-a423-47b4ae358e85 req-504e708d-59d2-4234-b566-573e46edf4d9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038698 Feb 28 19:16:41.518908 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 490/975] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:16:42.352384 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6ea8288e-42b9-43ed-b3f6-bd30aadf1737 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:42.352974 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6ea8288e-42b9-43ed-b3f6-bd30aadf1737 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:42.360348 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6ea8288e-42b9-43ed-b3f6-bd30aadf1737 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:42.370279 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6ea8288e-42b9-43ed-b3f6-bd30aadf1737 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:42.370279 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6ea8288e-42b9-43ed-b3f6-bd30aadf1737 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:42.370279 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6ea8288e-42b9-43ed-b3f6-bd30aadf1737 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:42.438708 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6ea8288e-42b9-43ed-b3f6-bd30aadf1737 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:42.439178 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6ea8288e-42b9-43ed-b3f6-bd30aadf1737 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:42.439629 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-6ea8288e-42b9-43ed-b3f6-bd30aadf1737 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lazy-loading 'fault' on Instance uuid a389097e-88f3-40cf-a37d-8ab80c1aadc5 {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:16:42.496412 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6ea8288e-42b9-43ed-b3f6-bd30aadf1737 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:42.505408 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6ea8288e-42b9-43ed-b3f6-bd30aadf1737 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 200 len: 1231 microversion: 2.1 time: 0.156709 Feb 28 19:16:42.505987 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 486/976] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:42 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 1231 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:43.523395 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d68d7063-4c32-4289-bea4-1eea36430aab tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:43.524096 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d68d7063-4c32-4289-bea4-1eea36430aab tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: a389097e-88f3-40cf-a37d-8ab80c1aadc5] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:43.531686 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d68d7063-4c32-4289-bea4-1eea36430aab tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:43.532133 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d68d7063-4c32-4289-bea4-1eea36430aab tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:43.532969 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d68d7063-4c32-4289-bea4-1eea36430aab tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:43.533336 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d68d7063-4c32-4289-bea4-1eea36430aab tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:43.582773 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-d68d7063-4c32-4289-bea4-1eea36430aab tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] HTTP exception thrown: Instance a389097e-88f3-40cf-a37d-8ab80c1aadc5 could not be found. Feb 28 19:16:43.583510 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d68d7063-4c32-4289-bea4-1eea36430aab tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Returning 404 to user: Instance a389097e-88f3-40cf-a37d-8ab80c1aadc5 could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:16:43.584315 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d68d7063-4c32-4289-bea4-1eea36430aab tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5" status: 404 len: 111 microversion: 2.1 time: 0.066219 Feb 28 19:16:43.584974 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 491/977] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:43 2022] GET /compute/v2.1/servers/a389097e-88f3-40cf-a37d-8ab80c1aadc5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:16:44.049051 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-cadd35fb-5df7-4504-9c01-9d28d723338e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:44.049563 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-cadd35fb-5df7-4504-9c01-9d28d723338e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:44.056792 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cadd35fb-5df7-4504-9c01-9d28d723338e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:44.057412 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cadd35fb-5df7-4504-9c01-9d28d723338e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:44.058174 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cadd35fb-5df7-4504-9c01-9d28d723338e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:44.058617 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-cadd35fb-5df7-4504-9c01-9d28d723338e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:44.220162 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-cadd35fb-5df7-4504-9c01-9d28d723338e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lazy-loading 'services' on Instance uuid 1630c283-c674-4fb1-be21-7eb220ea227f {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:16:44.512085 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-cadd35fb-5df7-4504-9c01-9d28d723338e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f/os-volume_attachments/c690ea90-25de-4fb0-8920-9858d515ddbf" status: 202 len: 0 microversion: 2.1 time: 0.466618 Feb 28 19:16:44.513059 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 487/978] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:16:44 2022] DELETE /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f/os-volume_attachments/c690ea90-25de-4fb0-8920-9858d515ddbf => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:16:46.771191 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-70323f8e-946e-4af7-a2c7-707db195f588 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:46.771746 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-70323f8e-946e-4af7-a2c7-707db195f588 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:46.778974 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-70323f8e-946e-4af7-a2c7-707db195f588 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:46.779471 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-70323f8e-946e-4af7-a2c7-707db195f588 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:46.780252 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-70323f8e-946e-4af7-a2c7-707db195f588 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:46.780686 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-70323f8e-946e-4af7-a2c7-707db195f588 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:46.844002 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-70323f8e-946e-4af7-a2c7-707db195f588 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Going to try to terminate instance {{(pid=101791) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:16:47.221068 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-70323f8e-946e-4af7-a2c7-707db195f588 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "DELETE /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 204 len: 0 microversion: 2.1 time: 0.454349 Feb 28 19:16:47.221660 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 492/979] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:16:46 2022] DELETE /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:16:47.231676 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-bd017ba8-39c6-4ecf-bdad-8ae5d5a2a8a0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:47.232374 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-bd017ba8-39c6-4ecf-bdad-8ae5d5a2a8a0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:47.240845 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bd017ba8-39c6-4ecf-bdad-8ae5d5a2a8a0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:47.241294 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bd017ba8-39c6-4ecf-bdad-8ae5d5a2a8a0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:47.242061 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bd017ba8-39c6-4ecf-bdad-8ae5d5a2a8a0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:47.242491 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-bd017ba8-39c6-4ecf-bdad-8ae5d5a2a8a0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:47.446023 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-bd017ba8-39c6-4ecf-bdad-8ae5d5a2a8a0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:47.454477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-bd017ba8-39c6-4ecf-bdad-8ae5d5a2a8a0 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1514 microversion: 2.1 time: 0.227190 Feb 28 19:16:47.455055 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 488/980] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:47 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:47.782209 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-9b73dbdc-02a9-4fd9-92ed-14f57f6ec12b req-69c78b05-7d02-4a0a-a940-cbad899e0a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd6925a-7700-4ae1-8032-cf7bd2513f3b", "tag": "a42c7f1f-fdd6-4089-ba61-437e667d8528"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:47.786094 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:16:47.786094 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:16:47.786903 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d7f89cac-875d-46e1-8373-b49344c80caf tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:47.788716 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d7f89cac-875d-46e1-8373-b49344c80caf tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:47.793508 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-9b73dbdc-02a9-4fd9-92ed-14f57f6ec12b req-69c78b05-7d02-4a0a-a940-cbad899e0a34 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:47.794338 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-9b73dbdc-02a9-4fd9-92ed-14f57f6ec12b req-69c78b05-7d02-4a0a-a940-cbad899e0a34 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:47.807738 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d7f89cac-875d-46e1-8373-b49344c80caf tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:47.808296 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d7f89cac-875d-46e1-8373-b49344c80caf tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:47.809145 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d7f89cac-875d-46e1-8373-b49344c80caf tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:47.809580 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d7f89cac-875d-46e1-8373-b49344c80caf tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:47.810348 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-9b73dbdc-02a9-4fd9-92ed-14f57f6ec12b req-69c78b05-7d02-4a0a-a940-cbad899e0a34 service nova] Creating event network-changed:a42c7f1f-fdd6-4089-ba61-437e667d8528 for instance dfd6925a-7700-4ae1-8032-cf7bd2513f3b on hv-cinder-83118 Feb 28 19:16:47.815149 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-9b73dbdc-02a9-4fd9-92ed-14f57f6ec12b req-69c78b05-7d02-4a0a-a940-cbad899e0a34 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036243 Feb 28 19:16:47.817816 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 489/981] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:16:47.874006 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d7f89cac-875d-46e1-8373-b49344c80caf tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Going to try to terminate instance {{(pid=101791) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:16:48.233065 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d7f89cac-875d-46e1-8373-b49344c80caf tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "DELETE /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 204 len: 0 microversion: 2.1 time: 0.456726 Feb 28 19:16:48.237015 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 493/982] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:16:47 2022] DELETE /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:16:48.244035 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9dac6002-3223-42dd-b862-c56c6970fc66 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:48.244727 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9dac6002-3223-42dd-b862-c56c6970fc66 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:48.252520 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9dac6002-3223-42dd-b862-c56c6970fc66 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:48.253321 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9dac6002-3223-42dd-b862-c56c6970fc66 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:48.254828 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9dac6002-3223-42dd-b862-c56c6970fc66 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:48.255453 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9dac6002-3223-42dd-b862-c56c6970fc66 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:48.465533 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9dac6002-3223-42dd-b862-c56c6970fc66 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:48.475837 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e6021032-5e6a-488d-be33-91e598046622 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:48.476917 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e6021032-5e6a-488d-be33-91e598046622 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:48.483315 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9dac6002-3223-42dd-b862-c56c6970fc66 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1578 microversion: 2.1 time: 0.243497 Feb 28 19:16:48.484311 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 490/983] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:48 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1578 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:48.495902 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e6021032-5e6a-488d-be33-91e598046622 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:48.496348 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e6021032-5e6a-488d-be33-91e598046622 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:48.497187 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e6021032-5e6a-488d-be33-91e598046622 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:48.497616 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e6021032-5e6a-488d-be33-91e598046622 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:48.722403 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e6021032-5e6a-488d-be33-91e598046622 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:48.731528 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e6021032-5e6a-488d-be33-91e598046622 tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1514 microversion: 2.1 time: 0.261359 Feb 28 19:16:48.732091 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 494/984] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:48 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:49.501909 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e31f09c2-3e5f-4933-a771-76ba6b482c65 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:49.502570 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e31f09c2-3e5f-4933-a771-76ba6b482c65 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:49.511528 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e31f09c2-3e5f-4933-a771-76ba6b482c65 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:49.512256 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e31f09c2-3e5f-4933-a771-76ba6b482c65 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:49.513041 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e31f09c2-3e5f-4933-a771-76ba6b482c65 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:49.513575 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e31f09c2-3e5f-4933-a771-76ba6b482c65 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:49.748522 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f5a1cf9b-e0c3-426a-ae78-602f64ce20fc tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:49.749223 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f5a1cf9b-e0c3-426a-ae78-602f64ce20fc tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:49.757307 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5a1cf9b-e0c3-426a-ae78-602f64ce20fc tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:49.757752 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5a1cf9b-e0c3-426a-ae78-602f64ce20fc tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:49.758522 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5a1cf9b-e0c3-426a-ae78-602f64ce20fc tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:49.758947 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5a1cf9b-e0c3-426a-ae78-602f64ce20fc tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:50.114605 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e31f09c2-3e5f-4933-a771-76ba6b482c65 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:50.125139 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e31f09c2-3e5f-4933-a771-76ba6b482c65 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1459 microversion: 2.1 time: 0.627512 Feb 28 19:16:50.125899 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 491/985] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:49 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1459 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:16:50.130935 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-7940765b-2eb1-4e5e-8fec-63d28f4e58bd req-801ce76b-aeee-4973-93f2-e0f2c4a02383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd6925a-7700-4ae1-8032-cf7bd2513f3b", "name": "network-vif-deleted", "tag": "a42c7f1f-fdd6-4089-ba61-437e667d8528"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:50.132562 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:16:50.132562 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:16:50.141060 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-7940765b-2eb1-4e5e-8fec-63d28f4e58bd req-801ce76b-aeee-4973-93f2-e0f2c4a02383 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:50.141562 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-7940765b-2eb1-4e5e-8fec-63d28f4e58bd req-801ce76b-aeee-4973-93f2-e0f2c4a02383 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:50.157863 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-7940765b-2eb1-4e5e-8fec-63d28f4e58bd req-801ce76b-aeee-4973-93f2-e0f2c4a02383 service nova] Creating event network-vif-deleted:a42c7f1f-fdd6-4089-ba61-437e667d8528 for instance dfd6925a-7700-4ae1-8032-cf7bd2513f3b on hv-cinder-83118 Feb 28 19:16:50.163395 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-7940765b-2eb1-4e5e-8fec-63d28f4e58bd req-801ce76b-aeee-4973-93f2-e0f2c4a02383 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036109 Feb 28 19:16:50.164387 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 492/986] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:16:50.229773 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f5a1cf9b-e0c3-426a-ae78-602f64ce20fc tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:50.237953 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f5a1cf9b-e0c3-426a-ae78-602f64ce20fc tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1514 microversion: 2.1 time: 0.493182 Feb 28 19:16:50.238774 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 495/987] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:49 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1514 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:16:50.428679 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-5f944481-8b3b-49e2-8a68-285dcfd270f8 req-06349333-7188-4b6f-af83-f183529cd4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1630c283-c674-4fb1-be21-7eb220ea227f", "name": "network-vif-deleted", "tag": "fb1c6728-f3d8-4fe4-866e-9a1da52cf317"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:16:50.430422 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:16:50.430422 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:16:50.439205 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-5f944481-8b3b-49e2-8a68-285dcfd270f8 req-06349333-7188-4b6f-af83-f183529cd4bd service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:50.439750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-5f944481-8b3b-49e2-8a68-285dcfd270f8 req-06349333-7188-4b6f-af83-f183529cd4bd service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:50.456239 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-5f944481-8b3b-49e2-8a68-285dcfd270f8 req-06349333-7188-4b6f-af83-f183529cd4bd service nova] Creating event network-vif-deleted:fb1c6728-f3d8-4fe4-866e-9a1da52cf317 for instance 1630c283-c674-4fb1-be21-7eb220ea227f on hv-cinder-83118 Feb 28 19:16:50.461568 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-5f944481-8b3b-49e2-8a68-285dcfd270f8 req-06349333-7188-4b6f-af83-f183529cd4bd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037082 Feb 28 19:16:50.462161 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 493/988] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:16:51.141587 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-cb1ea551-fe61-4a0a-88af-c5212a6d1062 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:51.142337 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-cb1ea551-fe61-4a0a-88af-c5212a6d1062 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:51.150222 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cb1ea551-fe61-4a0a-88af-c5212a6d1062 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:51.150663 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cb1ea551-fe61-4a0a-88af-c5212a6d1062 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:51.153599 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cb1ea551-fe61-4a0a-88af-c5212a6d1062 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:51.153599 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cb1ea551-fe61-4a0a-88af-c5212a6d1062 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:51.220788 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cb1ea551-fe61-4a0a-88af-c5212a6d1062 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:51.221225 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-cb1ea551-fe61-4a0a-88af-c5212a6d1062 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:51.221667 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-cb1ea551-fe61-4a0a-88af-c5212a6d1062 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lazy-loading 'fault' on Instance uuid dfd6925a-7700-4ae1-8032-cf7bd2513f3b {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:16:51.255461 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0fc66ddf-0ac4-4546-81c5-3803478ca43e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:51.256178 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0fc66ddf-0ac4-4546-81c5-3803478ca43e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:51.265741 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0fc66ddf-0ac4-4546-81c5-3803478ca43e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:51.266185 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0fc66ddf-0ac4-4546-81c5-3803478ca43e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:51.267129 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0fc66ddf-0ac4-4546-81c5-3803478ca43e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:51.267408 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0fc66ddf-0ac4-4546-81c5-3803478ca43e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:51.283865 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-cb1ea551-fe61-4a0a-88af-c5212a6d1062 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f038939b324d9b8e7214cec4e82933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90acc320256d4622a351a587d9f604c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:51.293817 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-cb1ea551-fe61-4a0a-88af-c5212a6d1062 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 200 len: 1231 microversion: 2.1 time: 0.156031 Feb 28 19:16:51.295768 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 496/989] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:51 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 1231 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:16:51.339909 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0fc66ddf-0ac4-4546-81c5-3803478ca43e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:51.340358 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0fc66ddf-0ac4-4546-81c5-3803478ca43e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:51.340807 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-0fc66ddf-0ac4-4546-81c5-3803478ca43e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lazy-loading 'fault' on Instance uuid 1630c283-c674-4fb1-be21-7eb220ea227f {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:16:51.480779 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-0fc66ddf-0ac4-4546-81c5-3803478ca43e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668df273a9344938c66d1ee69a42238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c06762c8979480f92330ac600b63c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:16:51.489420 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0fc66ddf-0ac4-4546-81c5-3803478ca43e tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 200 len: 1309 microversion: 2.1 time: 0.238643 Feb 28 19:16:51.489984 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 494/990] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:51 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 1309 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:16:52.310806 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-36ebd002-4cc1-4c24-93f1-8853953ae099 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:52.311387 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-36ebd002-4cc1-4c24-93f1-8853953ae099 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: dfd6925a-7700-4ae1-8032-cf7bd2513f3b] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:52.319746 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36ebd002-4cc1-4c24-93f1-8853953ae099 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:52.320187 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36ebd002-4cc1-4c24-93f1-8853953ae099 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:52.320942 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36ebd002-4cc1-4c24-93f1-8853953ae099 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:52.321367 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36ebd002-4cc1-4c24-93f1-8853953ae099 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:52.372001 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-36ebd002-4cc1-4c24-93f1-8853953ae099 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] HTTP exception thrown: Instance dfd6925a-7700-4ae1-8032-cf7bd2513f3b could not be found. Feb 28 19:16:52.372594 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-36ebd002-4cc1-4c24-93f1-8853953ae099 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Returning 404 to user: Instance dfd6925a-7700-4ae1-8032-cf7bd2513f3b could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:16:52.373397 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-36ebd002-4cc1-4c24-93f1-8853953ae099 tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b" status: 404 len: 111 microversion: 2.1 time: 0.066392 Feb 28 19:16:52.373934 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 497/991] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:52 2022] GET /compute/v2.1/servers/dfd6925a-7700-4ae1-8032-cf7bd2513f3b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:16:52.512007 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e2152b5e-048e-4c4a-9533-d2e018ea1f7c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:52.512623 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e2152b5e-048e-4c4a-9533-d2e018ea1f7c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] [instance: 1630c283-c674-4fb1-be21-7eb220ea227f] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:52.520903 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2152b5e-048e-4c4a-9533-d2e018ea1f7c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:52.521328 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2152b5e-048e-4c4a-9533-d2e018ea1f7c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:52.522096 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2152b5e-048e-4c4a-9533-d2e018ea1f7c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:52.522527 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e2152b5e-048e-4c4a-9533-d2e018ea1f7c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:52.572889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-e2152b5e-048e-4c4a-9533-d2e018ea1f7c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] HTTP exception thrown: Instance 1630c283-c674-4fb1-be21-7eb220ea227f could not be found. Feb 28 19:16:52.573401 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e2152b5e-048e-4c4a-9533-d2e018ea1f7c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] Returning 404 to user: Instance 1630c283-c674-4fb1-be21-7eb220ea227f could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:16:52.574236 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e2152b5e-048e-4c4a-9533-d2e018ea1f7c tempest-VolumesSnapshotTestJSON-307199026 tempest-VolumesSnapshotTestJSON-307199026-project] 10.222.0.21 "GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f" status: 404 len: 111 microversion: 2.1 time: 0.066307 Feb 28 19:16:52.574790 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 495/992] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:52 2022] GET /compute/v2.1/servers/1630c283-c674-4fb1-be21-7eb220ea227f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:16:53.230883 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d6776b73-a6a9-4820-8be1-943eb388132e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:53.231425 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d6776b73-a6a9-4820-8be1-943eb388132e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:53.239385 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d6776b73-a6a9-4820-8be1-943eb388132e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:53.239833 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d6776b73-a6a9-4820-8be1-943eb388132e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:53.240600 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d6776b73-a6a9-4820-8be1-943eb388132e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:53.241029 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d6776b73-a6a9-4820-8be1-943eb388132e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:53.290705 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-d6776b73-a6a9-4820-8be1-943eb388132e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] HTTP exception thrown: Instance 629f35f4-df5f-4e49-a667-11c0cc7d7fed could not be found. Feb 28 19:16:53.291340 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d6776b73-a6a9-4820-8be1-943eb388132e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Returning 404 to user: Instance 629f35f4-df5f-4e49-a667-11c0cc7d7fed could not be found. {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:16:53.292160 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d6776b73-a6a9-4820-8be1-943eb388132e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "DELETE /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 404 len: 111 microversion: 2.1 time: 0.065055 Feb 28 19:16:53.292717 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 498/993] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:16:53 2022] DELETE /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:16:53.300403 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ee9cd7fc-0982-44a2-8348-d229c38b9e8e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:53.301500 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-ee9cd7fc-0982-44a2-8348-d229c38b9e8e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] [instance: 629f35f4-df5f-4e49-a667-11c0cc7d7fed] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:16:53.308685 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ee9cd7fc-0982-44a2-8348-d229c38b9e8e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:53.309135 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ee9cd7fc-0982-44a2-8348-d229c38b9e8e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:53.309900 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ee9cd7fc-0982-44a2-8348-d229c38b9e8e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:16:53.310334 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-ee9cd7fc-0982-44a2-8348-d229c38b9e8e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:16:53.362459 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-ee9cd7fc-0982-44a2-8348-d229c38b9e8e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] HTTP exception thrown: Instance 629f35f4-df5f-4e49-a667-11c0cc7d7fed could not be found. Feb 28 19:16:53.363521 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-ee9cd7fc-0982-44a2-8348-d229c38b9e8e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Returning 404 to user: Instance 629f35f4-df5f-4e49-a667-11c0cc7d7fed could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:16:53.364346 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-ee9cd7fc-0982-44a2-8348-d229c38b9e8e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed" status: 404 len: 111 microversion: 2.1 time: 0.067531 Feb 28 19:16:53.364883 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 496/994] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:16:53 2022] GET /compute/v2.1/servers/629f35f4-df5f-4e49-a667-11c0cc7d7fed => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:16:55.084952 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-07eb468a-a6d4-4b2d-ada3-9f3ff565e58e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] Calling method '.version_select at 0x7f912e4523a0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:16:55.158735 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-07eb468a-a6d4-4b2d-ada3-9f3ff565e58e tempest-TestVolumeBootPattern-999397042 tempest-TestVolumeBootPattern-999397042-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1298881284" status: 202 len: 0 microversion: 2.1 time: 0.078029 Feb 28 19:16:55.159322 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 499/995] 10.222.0.21 () {58 vars in 1262 bytes} [Mon Feb 28 19:16:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1298881284 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:17:00.898755 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:17:00.899416 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: Mon Feb 28 19:17:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:17:41.014885 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b45e5e44-6bba-4443-8e4a-39af05d3d373 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Action: 'create', calling method: .version_select at 0x7f912e2a9e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1156493615"}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:17:41.036990 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-b45e5e44-6bba-4443-8e4a-39af05d3d373 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Getting quotas for project 71617ef8c9904a419b7928654b614f08. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:17:41.040704 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-b45e5e44-6bba-4443-8e4a-39af05d3d373 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Getting quotas for user c75426eab49c4b579411c05048f16184 and project 71617ef8c9904a419b7928654b614f08. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:17:41.266122 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-b45e5e44-6bba-4443-8e4a-39af05d3d373 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Getting quotas for project 71617ef8c9904a419b7928654b614f08. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:17:41.269988 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.quota [None req-b45e5e44-6bba-4443-8e4a-39af05d3d373 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Getting quotas for user c75426eab49c4b579411c05048f16184 and project 71617ef8c9904a419b7928654b614f08. Resources: {'key_pairs'} {{(pid=101792) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:17:41.282333 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b45e5e44-6bba-4443-8e4a-39af05d3d373 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.483433 Feb 28 19:17:41.282924 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 497/996] 10.222.0.21 () {60 vars in 1157 bytes} [Mon Feb 28 19:17:40 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:17:45.079611 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-45ae6f14-23cb-4752-ad3f-a2420c4020b2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:17:45.080550 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-45ae6f14-23cb-4752-ad3f-a2420c4020b2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:45.090599 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-45ae6f14-23cb-4752-ad3f-a2420c4020b2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:45.091043 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-45ae6f14-23cb-4752-ad3f-a2420c4020b2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:45.091929 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-45ae6f14-23cb-4752-ad3f-a2420c4020b2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:45.092496 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-45ae6f14-23cb-4752-ad3f-a2420c4020b2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:45.389869 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-45ae6f14-23cb-4752-ad3f-a2420c4020b2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "POST /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/action" status: 202 len: 0 microversion: 2.1 time: 0.314476 Feb 28 19:17:45.399956 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 500/997] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:17:45 2022] POST /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:17:45.400157 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-62428edc-803d-431b-97fb-5949f4a574d9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:17:45.400157 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-62428edc-803d-431b-97fb-5949f4a574d9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:45.407732 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-62428edc-803d-431b-97fb-5949f4a574d9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:45.408193 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-62428edc-803d-431b-97fb-5949f4a574d9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:45.408977 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-62428edc-803d-431b-97fb-5949f4a574d9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:45.409415 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-62428edc-803d-431b-97fb-5949f4a574d9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:45.857571 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-62428edc-803d-431b-97fb-5949f4a574d9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:17:45.872667 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-62428edc-803d-431b-97fb-5949f4a574d9 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1753 microversion: 2.1 time: 0.477591 Feb 28 19:17:45.883216 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 498/998] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:17:45 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1753 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:17:46.891629 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-38ae972d-8b9e-4e4d-81ca-a7a1d7803ccd tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:17:46.892325 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-38ae972d-8b9e-4e4d-81ca-a7a1d7803ccd tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:46.900584 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-38ae972d-8b9e-4e4d-81ca-a7a1d7803ccd tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:46.901028 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-38ae972d-8b9e-4e4d-81ca-a7a1d7803ccd tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:46.901823 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-38ae972d-8b9e-4e4d-81ca-a7a1d7803ccd tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:46.902251 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-38ae972d-8b9e-4e4d-81ca-a7a1d7803ccd tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:47.166972 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-38ae972d-8b9e-4e4d-81ca-a7a1d7803ccd tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:17:47.175629 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-38ae972d-8b9e-4e4d-81ca-a7a1d7803ccd tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1753 microversion: 2.1 time: 0.288544 Feb 28 19:17:47.176257 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 501/999] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:17:46 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1753 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:17:48.192889 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4884f19e-dfbf-43e3-b9f2-9b60f3e301a2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:17:48.193576 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4884f19e-dfbf-43e3-b9f2-9b60f3e301a2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:48.200782 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4884f19e-dfbf-43e3-b9f2-9b60f3e301a2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:48.201225 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4884f19e-dfbf-43e3-b9f2-9b60f3e301a2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:48.201988 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4884f19e-dfbf-43e3-b9f2-9b60f3e301a2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:48.202416 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4884f19e-dfbf-43e3-b9f2-9b60f3e301a2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:48.407151 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4884f19e-dfbf-43e3-b9f2-9b60f3e301a2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:17:48.417136 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4884f19e-dfbf-43e3-b9f2-9b60f3e301a2 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1758 microversion: 2.1 time: 0.228059 Feb 28 19:17:48.417704 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 499/1000] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:17:48 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1758 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:17:49.434707 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5f29f290-8ff0-4d50-a3f4-6c10133178ee tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:17:49.435350 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5f29f290-8ff0-4d50-a3f4-6c10133178ee tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:49.443479 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5f29f290-8ff0-4d50-a3f4-6c10133178ee tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:49.444298 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5f29f290-8ff0-4d50-a3f4-6c10133178ee tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:49.444711 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5f29f290-8ff0-4d50-a3f4-6c10133178ee tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:49.445667 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5f29f290-8ff0-4d50-a3f4-6c10133178ee tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:49.655168 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5f29f290-8ff0-4d50-a3f4-6c10133178ee tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:17:49.664278 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5f29f290-8ff0-4d50-a3f4-6c10133178ee tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1758 microversion: 2.1 time: 0.233255 Feb 28 19:17:49.664832 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 502/1001] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:17:49 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1758 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:17:50.682270 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-36406081-d4a1-40f2-ba75-2948fe5da987 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:17:50.682895 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-36406081-d4a1-40f2-ba75-2948fe5da987 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:50.690216 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-36406081-d4a1-40f2-ba75-2948fe5da987 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:50.690655 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-36406081-d4a1-40f2-ba75-2948fe5da987 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:50.691624 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-36406081-d4a1-40f2-ba75-2948fe5da987 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:50.692104 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-36406081-d4a1-40f2-ba75-2948fe5da987 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:50.896571 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-36406081-d4a1-40f2-ba75-2948fe5da987 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:17:50.905221 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-36406081-d4a1-40f2-ba75-2948fe5da987 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1758 microversion: 2.1 time: 0.226631 Feb 28 19:17:50.905779 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 500/1002] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:17:50 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1758 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:17:51.927158 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c721d51c-9432-4fbb-a57b-5a3542dda267 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:17:51.927158 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c721d51c-9432-4fbb-a57b-5a3542dda267 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:51.932847 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c721d51c-9432-4fbb-a57b-5a3542dda267 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:51.933296 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c721d51c-9432-4fbb-a57b-5a3542dda267 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:51.934080 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c721d51c-9432-4fbb-a57b-5a3542dda267 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:51.934512 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c721d51c-9432-4fbb-a57b-5a3542dda267 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:52.133287 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c721d51c-9432-4fbb-a57b-5a3542dda267 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:17:52.142086 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c721d51c-9432-4fbb-a57b-5a3542dda267 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1758 microversion: 2.1 time: 0.222750 Feb 28 19:17:52.146462 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 503/1003] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:17:51 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1758 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:17:53.161373 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2e0e6150-6a57-46f8-96e6-3f44b97e4af1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:17:53.161927 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2e0e6150-6a57-46f8-96e6-3f44b97e4af1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:53.169293 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e0e6150-6a57-46f8-96e6-3f44b97e4af1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:53.169745 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e0e6150-6a57-46f8-96e6-3f44b97e4af1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:53.170554 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e0e6150-6a57-46f8-96e6-3f44b97e4af1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:53.170992 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2e0e6150-6a57-46f8-96e6-3f44b97e4af1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:53.466720 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2e0e6150-6a57-46f8-96e6-3f44b97e4af1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:17:53.476518 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2e0e6150-6a57-46f8-96e6-3f44b97e4af1 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1758 microversion: 2.1 time: 0.319088 Feb 28 19:17:53.477084 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 501/1004] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:17:53 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1758 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:17:54.494364 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2cbb2c70-0050-4da8-9165-250a51908784 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:17:54.494978 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-2cbb2c70-0050-4da8-9165-250a51908784 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:54.502303 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2cbb2c70-0050-4da8-9165-250a51908784 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:54.503013 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2cbb2c70-0050-4da8-9165-250a51908784 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:54.503534 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2cbb2c70-0050-4da8-9165-250a51908784 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:54.504077 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2cbb2c70-0050-4da8-9165-250a51908784 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:54.845615 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-2cbb2c70-0050-4da8-9165-250a51908784 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:17:54.854596 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2cbb2c70-0050-4da8-9165-250a51908784 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1758 microversion: 2.1 time: 0.363935 Feb 28 19:17:54.855166 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 504/1005] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:17:54 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1758 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:17:55.872277 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-aa28fb44-f3cb-4639-bd20-81f6742e0386 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:17:55.873232 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-aa28fb44-f3cb-4639-bd20-81f6742e0386 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:55.881043 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aa28fb44-f3cb-4639-bd20-81f6742e0386 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:55.881481 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aa28fb44-f3cb-4639-bd20-81f6742e0386 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:55.882242 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aa28fb44-f3cb-4639-bd20-81f6742e0386 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:55.882669 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-aa28fb44-f3cb-4639-bd20-81f6742e0386 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:56.084769 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-aa28fb44-f3cb-4639-bd20-81f6742e0386 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:17:56.093415 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-aa28fb44-f3cb-4639-bd20-81f6742e0386 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1758 microversion: 2.1 time: 0.224728 Feb 28 19:17:56.093969 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 502/1006] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:17:55 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1758 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:17:57.111399 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2115845a-39d4-43b9-bb11-98ab45fa752b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:17:57.111948 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-2115845a-39d4-43b9-bb11-98ab45fa752b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:57.119565 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2115845a-39d4-43b9-bb11-98ab45fa752b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:57.120026 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2115845a-39d4-43b9-bb11-98ab45fa752b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:57.120789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2115845a-39d4-43b9-bb11-98ab45fa752b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:57.121214 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2115845a-39d4-43b9-bb11-98ab45fa752b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:57.318568 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-2115845a-39d4-43b9-bb11-98ab45fa752b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:17:57.327163 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2115845a-39d4-43b9-bb11-98ab45fa752b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1758 microversion: 2.1 time: 0.219495 Feb 28 19:17:57.327717 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 505/1007] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:17:57 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1758 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:17:58.344650 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-9a91e673-320a-4dee-aa62-0ac8d4971a02 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:17:58.345323 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-9a91e673-320a-4dee-aa62-0ac8d4971a02 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:17:58.353092 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9a91e673-320a-4dee-aa62-0ac8d4971a02 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:58.353540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9a91e673-320a-4dee-aa62-0ac8d4971a02 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:58.354310 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9a91e673-320a-4dee-aa62-0ac8d4971a02 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:17:58.354745 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-9a91e673-320a-4dee-aa62-0ac8d4971a02 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:17:58.555526 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-9a91e673-320a-4dee-aa62-0ac8d4971a02 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:17:58.564173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-9a91e673-320a-4dee-aa62-0ac8d4971a02 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1761 microversion: 2.1 time: 0.223185 Feb 28 19:17:58.564752 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 503/1008] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:17:58 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1761 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:06.609700 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-368888992", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1156493615", "security_groups": [{"name": "tempest-secgroup-smoke-2023315788"}], "networks": [{"uuid": "cc1d65af-cc14-42ab-b1bb-32d93de27a1d"}], "block_device_mapping_v2": [{"uuid": "ca288714-626f-456c-bd65-89a1ed4800a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:18:06.838090 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.network.neutron [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] validate_networks() for [('cc1d65af-cc14-42ab-b1bb-32d93de27a1d', None, None, None)] {{(pid=101791) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Feb 28 19:18:07.521928 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Flavor limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 28 19:18:07.522352 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Image limits 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 28 19:18:07.522830 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Flavor pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 28 19:18:07.523328 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Image pref 0:0:0 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 28 19:18:07.523747 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.virt.hardware [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101791) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 28 19:18:07.532025 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:07.532469 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:07.533267 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:07.533699 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:07.550323 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Getting quotas for project 71617ef8c9904a419b7928654b614f08. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 28 19:18:07.554269 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.quota [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Getting quotas for user c75426eab49c4b579411c05048f16184 and project 71617ef8c9904a419b7928654b614f08. Resources: {'ram', 'instances', 'cores'} {{(pid=101791) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 28 19:18:07.641166 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Going to run 1 instances... {{(pid=101791) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Feb 28 19:18:07.643557 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca288714-626f-456c-bd65-89a1ed4800a4',volume_size=None,volume_type=None)] {{(pid=101791) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Feb 28 19:18:08.072015 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e370615b-dbe5-40a5-a713-c404762f6511 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.465797 Feb 28 19:18:08.072558 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 506/1009] 10.222.0.21 () {60 vars in 1146 bytes} [Mon Feb 28 19:18:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 28 19:18:08.080480 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0ff264c-44f7-4e38-951f-4edc98ed008f] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 28 19:18:08.084099 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c58fffa8-f95b-465e-aba0-5fb8da5d7bc0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:08.085060 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c58fffa8-f95b-465e-aba0-5fb8da5d7bc0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:08.156380 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c58fffa8-f95b-465e-aba0-5fb8da5d7bc0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:08.164255 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c58fffa8-f95b-465e-aba0-5fb8da5d7bc0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1088 microversion: 2.1 time: 0.085214 Feb 28 19:18:08.164809 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 504/1010] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:08 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:09.180764 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a608cbb7-f4fb-40c7-a407-bb9ea8a6c1a2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:09.181537 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a608cbb7-f4fb-40c7-a407-bb9ea8a6c1a2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:09.260261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a608cbb7-f4fb-40c7-a407-bb9ea8a6c1a2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:09.268443 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a608cbb7-f4fb-40c7-a407-bb9ea8a6c1a2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1088 microversion: 2.1 time: 0.090959 Feb 28 19:18:09.268929 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 507/1011] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:09 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1088 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:10.285984 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-469a4244-8f40-4e32-a15b-9eea06b61790 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:10.286598 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-469a4244-8f40-4e32-a15b-9eea06b61790 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:10.311891 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0ff264c-44f7-4e38-951f-4edc98ed008f] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 39176. Feb 28 19:18:10.360982 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-469a4244-8f40-4e32-a15b-9eea06b61790 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:10.369172 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-469a4244-8f40-4e32-a15b-9eea06b61790 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1088 microversion: 2.1 time: 0.086822 Feb 28 19:18:10.369969 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 505/1012] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:10 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1088 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:11.386254 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-24c71a21-7f34-4d01-8703-24a4e9ef4b3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:11.386807 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-24c71a21-7f34-4d01-8703-24a4e9ef4b3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:11.453819 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-24c71a21-7f34-4d01-8703-24a4e9ef4b3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:11.461566 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-24c71a21-7f34-4d01-8703-24a4e9ef4b3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1088 microversion: 2.1 time: 0.079060 Feb 28 19:18:11.462115 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 508/1013] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:11 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:12.477831 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6b37cdf1-a940-4854-b733-2a15c2fe1d91 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:12.478477 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6b37cdf1-a940-4854-b733-2a15c2fe1d91 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:12.485662 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6b37cdf1-a940-4854-b733-2a15c2fe1d91 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:12.486102 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6b37cdf1-a940-4854-b733-2a15c2fe1d91 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:12.486865 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6b37cdf1-a940-4854-b733-2a15c2fe1d91 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:12.487322 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6b37cdf1-a940-4854-b733-2a15c2fe1d91 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:12.600108 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-6b37cdf1-a940-4854-b733-2a15c2fe1d91 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:12.608077 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6b37cdf1-a940-4854-b733-2a15c2fe1d91 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1138 microversion: 2.1 time: 0.134150 Feb 28 19:18:12.608633 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 506/1014] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:12 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1138 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:13.625210 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f4a6f38a-fbb4-43ec-a364-18ef8e6ebbba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:13.625768 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f4a6f38a-fbb4-43ec-a364-18ef8e6ebbba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:13.634074 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f4a6f38a-fbb4-43ec-a364-18ef8e6ebbba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:13.635356 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f4a6f38a-fbb4-43ec-a364-18ef8e6ebbba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:13.635356 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f4a6f38a-fbb4-43ec-a364-18ef8e6ebbba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:13.635720 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f4a6f38a-fbb4-43ec-a364-18ef8e6ebbba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:13.746551 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f4a6f38a-fbb4-43ec-a364-18ef8e6ebbba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:13.755236 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f4a6f38a-fbb4-43ec-a364-18ef8e6ebbba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1138 microversion: 2.1 time: 0.133819 Feb 28 19:18:13.756474 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 509/1015] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:13 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1138 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:14.773073 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1e1db008-9e25-4378-8a55-78493a75d093 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:14.773677 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1e1db008-9e25-4378-8a55-78493a75d093 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:14.780841 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1e1db008-9e25-4378-8a55-78493a75d093 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:14.781276 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1e1db008-9e25-4378-8a55-78493a75d093 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:14.782036 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1e1db008-9e25-4378-8a55-78493a75d093 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:14.782465 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1e1db008-9e25-4378-8a55-78493a75d093 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:15.003000 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1e1db008-9e25-4378-8a55-78493a75d093 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:15.011801 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1e1db008-9e25-4378-8a55-78493a75d093 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1204 microversion: 2.1 time: 0.243008 Feb 28 19:18:15.012381 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 507/1016] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:14 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1204 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:16.029787 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-df294b70-0970-41bd-b560-4fda8320f809 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:16.030436 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-df294b70-0970-41bd-b560-4fda8320f809 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:16.038255 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-df294b70-0970-41bd-b560-4fda8320f809 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:16.038709 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-df294b70-0970-41bd-b560-4fda8320f809 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:16.039576 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-df294b70-0970-41bd-b560-4fda8320f809 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:16.040015 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-df294b70-0970-41bd-b560-4fda8320f809 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:16.572716 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-df294b70-0970-41bd-b560-4fda8320f809 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:16.582067 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-df294b70-0970-41bd-b560-4fda8320f809 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1272 microversion: 2.1 time: 0.556071 Feb 28 19:18:16.592072 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 510/1017] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:16 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1272 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:16.953959 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-54fddb41-683b-4028-b853-5dac353d1b5b req-440a90e3-f78c-4e9f-b390-9b16cc7b6847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3da9bff-0b43-4aa3-acfd-fb44382d4999", "tag": "5d85a9de-2848-49e6-bde0-37a231102506"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:18:16.955536 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:18:16.955536 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:18:16.965270 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-54fddb41-683b-4028-b853-5dac353d1b5b req-440a90e3-f78c-4e9f-b390-9b16cc7b6847 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:16.965709 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-54fddb41-683b-4028-b853-5dac353d1b5b req-440a90e3-f78c-4e9f-b390-9b16cc7b6847 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:16.987728 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-54fddb41-683b-4028-b853-5dac353d1b5b req-440a90e3-f78c-4e9f-b390-9b16cc7b6847 service nova] Creating event network-changed:5d85a9de-2848-49e6-bde0-37a231102506 for instance a3da9bff-0b43-4aa3-acfd-fb44382d4999 on hv-cinder-83118 Feb 28 19:18:16.993171 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-54fddb41-683b-4028-b853-5dac353d1b5b req-440a90e3-f78c-4e9f-b390-9b16cc7b6847 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042699 Feb 28 19:18:16.993853 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 508/1018] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:18:17.598684 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-e244093f-88ed-49a7-ba86-a5ffe96c96a5 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:17.599427 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-e244093f-88ed-49a7-ba86-a5ffe96c96a5 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:17.606903 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e244093f-88ed-49a7-ba86-a5ffe96c96a5 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:17.607388 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e244093f-88ed-49a7-ba86-a5ffe96c96a5 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:17.608151 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e244093f-88ed-49a7-ba86-a5ffe96c96a5 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:17.608583 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-e244093f-88ed-49a7-ba86-a5ffe96c96a5 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:17.882260 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-e244093f-88ed-49a7-ba86-a5ffe96c96a5 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:17.890650 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-e244093f-88ed-49a7-ba86-a5ffe96c96a5 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1260 microversion: 2.1 time: 0.295502 Feb 28 19:18:17.896308 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 511/1019] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:17 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:18.908700 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7253ba8c-2e5e-4de4-be65-b9fe23d48df9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:18.909390 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7253ba8c-2e5e-4de4-be65-b9fe23d48df9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:18.916835 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7253ba8c-2e5e-4de4-be65-b9fe23d48df9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:18.917285 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7253ba8c-2e5e-4de4-be65-b9fe23d48df9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:18.918046 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7253ba8c-2e5e-4de4-be65-b9fe23d48df9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:18.918478 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7253ba8c-2e5e-4de4-be65-b9fe23d48df9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:19.112726 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7253ba8c-2e5e-4de4-be65-b9fe23d48df9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:19.121429 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7253ba8c-2e5e-4de4-be65-b9fe23d48df9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1260 microversion: 2.1 time: 0.216906 Feb 28 19:18:19.121973 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 509/1020] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:18 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:20.137587 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c8ade55d-a049-414f-8412-9519f1c2296f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:20.138157 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c8ade55d-a049-414f-8412-9519f1c2296f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:20.145730 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c8ade55d-a049-414f-8412-9519f1c2296f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:20.147458 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c8ade55d-a049-414f-8412-9519f1c2296f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:20.147574 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c8ade55d-a049-414f-8412-9519f1c2296f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:20.148084 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c8ade55d-a049-414f-8412-9519f1c2296f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:20.338390 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c8ade55d-a049-414f-8412-9519f1c2296f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:20.346392 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c8ade55d-a049-414f-8412-9519f1c2296f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1260 microversion: 2.1 time: 0.212542 Feb 28 19:18:20.346940 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 512/1021] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:20 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:21.362728 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-133337a5-437e-4792-b1a2-84833b2803af tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:21.363280 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-133337a5-437e-4792-b1a2-84833b2803af tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:21.370697 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-133337a5-437e-4792-b1a2-84833b2803af tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:21.371159 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-133337a5-437e-4792-b1a2-84833b2803af tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:21.371927 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-133337a5-437e-4792-b1a2-84833b2803af tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:21.372351 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-133337a5-437e-4792-b1a2-84833b2803af tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:21.578671 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-133337a5-437e-4792-b1a2-84833b2803af tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:21.587373 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-133337a5-437e-4792-b1a2-84833b2803af tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1260 microversion: 2.1 time: 0.228383 Feb 28 19:18:21.587935 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 510/1022] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:21 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:22.608838 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-145b3eda-66ff-46c9-906a-6c424f592cc1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:22.609429 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-145b3eda-66ff-46c9-906a-6c424f592cc1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:22.617332 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-145b3eda-66ff-46c9-906a-6c424f592cc1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:22.617774 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-145b3eda-66ff-46c9-906a-6c424f592cc1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:22.618532 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-145b3eda-66ff-46c9-906a-6c424f592cc1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:22.618964 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-145b3eda-66ff-46c9-906a-6c424f592cc1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:22.648313 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:18:22.648766 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: Mon Feb 28 19:18:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:18:22.814900 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-145b3eda-66ff-46c9-906a-6c424f592cc1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:22.822996 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-145b3eda-66ff-46c9-906a-6c424f592cc1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1260 microversion: 2.1 time: 0.218059 Feb 28 19:18:22.823577 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 513/1023] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:22 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:23.842507 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-714fb315-5b9f-42db-a7d7-df2be2d2e091 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:23.843142 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-714fb315-5b9f-42db-a7d7-df2be2d2e091 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:23.850399 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-714fb315-5b9f-42db-a7d7-df2be2d2e091 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:23.851397 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-714fb315-5b9f-42db-a7d7-df2be2d2e091 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:23.852339 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-714fb315-5b9f-42db-a7d7-df2be2d2e091 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:23.852809 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-714fb315-5b9f-42db-a7d7-df2be2d2e091 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:24.050759 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-714fb315-5b9f-42db-a7d7-df2be2d2e091 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:24.059918 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-714fb315-5b9f-42db-a7d7-df2be2d2e091 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1260 microversion: 2.1 time: 0.221172 Feb 28 19:18:24.060487 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 511/1024] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:23 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:25.076538 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d91118a7-9192-477f-beeb-4a4e6c829407 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:25.077184 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d91118a7-9192-477f-beeb-4a4e6c829407 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:25.084617 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d91118a7-9192-477f-beeb-4a4e6c829407 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:25.085122 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d91118a7-9192-477f-beeb-4a4e6c829407 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:25.086494 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d91118a7-9192-477f-beeb-4a4e6c829407 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:25.086934 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d91118a7-9192-477f-beeb-4a4e6c829407 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:25.286530 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-d91118a7-9192-477f-beeb-4a4e6c829407 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:25.295140 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d91118a7-9192-477f-beeb-4a4e6c829407 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1260 microversion: 2.1 time: 0.222341 Feb 28 19:18:25.295697 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 514/1025] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:25 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:26.312015 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d0fcc074-6082-42a2-8970-bb1a8045222f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:26.312622 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d0fcc074-6082-42a2-8970-bb1a8045222f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:26.320204 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d0fcc074-6082-42a2-8970-bb1a8045222f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:26.321288 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d0fcc074-6082-42a2-8970-bb1a8045222f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:26.321415 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d0fcc074-6082-42a2-8970-bb1a8045222f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:26.321919 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d0fcc074-6082-42a2-8970-bb1a8045222f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:26.512843 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d0fcc074-6082-42a2-8970-bb1a8045222f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:26.521149 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d0fcc074-6082-42a2-8970-bb1a8045222f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1260 microversion: 2.1 time: 0.212823 Feb 28 19:18:26.521723 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 512/1026] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:26 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 28 19:18:27.537626 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a673ddf3-e676-49ee-9237-91bd48f14e3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:27.538158 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a673ddf3-e676-49ee-9237-91bd48f14e3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:27.545629 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a673ddf3-e676-49ee-9237-91bd48f14e3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:27.546069 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a673ddf3-e676-49ee-9237-91bd48f14e3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:27.546847 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a673ddf3-e676-49ee-9237-91bd48f14e3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:27.547306 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a673ddf3-e676-49ee-9237-91bd48f14e3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:27.827290 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a673ddf3-e676-49ee-9237-91bd48f14e3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:27.835900 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a673ddf3-e676-49ee-9237-91bd48f14e3e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1260 microversion: 2.1 time: 0.301563 Feb 28 19:18:27.836793 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 515/1027] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:27 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1260 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:28.853782 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-90081075-bbdf-4bb5-b20e-18b50eb16cd6 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:28.854442 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-90081075-bbdf-4bb5-b20e-18b50eb16cd6 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:28.861920 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-90081075-bbdf-4bb5-b20e-18b50eb16cd6 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:28.862945 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-90081075-bbdf-4bb5-b20e-18b50eb16cd6 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:28.863796 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-90081075-bbdf-4bb5-b20e-18b50eb16cd6 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:28.864711 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-90081075-bbdf-4bb5-b20e-18b50eb16cd6 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:28.952087 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-9d24badd-0411-4258-8892-c2952e2b4395 req-fc32fbe1-caf7-41c2-a915-a31b67e0940c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3da9bff-0b43-4aa3-acfd-fb44382d4999", "name": "network-vif-plugged", "status": "completed", "tag": "5d85a9de-2848-49e6-bde0-37a231102506"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:18:28.953632 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:18:28.953632 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:18:28.962398 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-9d24badd-0411-4258-8892-c2952e2b4395 req-fc32fbe1-caf7-41c2-a915-a31b67e0940c service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:28.962838 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-9d24badd-0411-4258-8892-c2952e2b4395 req-fc32fbe1-caf7-41c2-a915-a31b67e0940c service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:28.985611 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.compute.server_external_events [req-9d24badd-0411-4258-8892-c2952e2b4395 req-fc32fbe1-caf7-41c2-a915-a31b67e0940c service nova] Creating event network-vif-plugged:5d85a9de-2848-49e6-bde0-37a231102506 for instance a3da9bff-0b43-4aa3-acfd-fb44382d4999 on hv-cinder-83118 Feb 28 19:18:28.990888 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-9d24badd-0411-4258-8892-c2952e2b4395 req-fc32fbe1-caf7-41c2-a915-a31b67e0940c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102024 Feb 28 19:18:28.992294 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 516/1028] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:18:29.075766 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-90081075-bbdf-4bb5-b20e-18b50eb16cd6 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:29.083986 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-90081075-bbdf-4bb5-b20e-18b50eb16cd6 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1260 microversion: 2.1 time: 0.234058 Feb 28 19:18:29.084582 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 513/1029] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:28 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:30.101552 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-70e1cbb5-da7a-49b6-a94d-f69b415cc654 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:30.102175 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-70e1cbb5-da7a-49b6-a94d-f69b415cc654 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:30.109567 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-70e1cbb5-da7a-49b6-a94d-f69b415cc654 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:30.110005 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-70e1cbb5-da7a-49b6-a94d-f69b415cc654 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:30.110772 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-70e1cbb5-da7a-49b6-a94d-f69b415cc654 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:30.111384 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-70e1cbb5-da7a-49b6-a94d-f69b415cc654 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:30.310122 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-70e1cbb5-da7a-49b6-a94d-f69b415cc654 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:30.318128 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-70e1cbb5-da7a-49b6-a94d-f69b415cc654 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1260 microversion: 2.1 time: 0.221006 Feb 28 19:18:30.318680 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 517/1030] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:30 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:31.334595 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-96df7d31-9eb5-4695-8fbd-3dfdaa83e0e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:31.335194 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-96df7d31-9eb5-4695-8fbd-3dfdaa83e0e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:31.342968 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96df7d31-9eb5-4695-8fbd-3dfdaa83e0e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:31.343431 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96df7d31-9eb5-4695-8fbd-3dfdaa83e0e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:31.344184 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96df7d31-9eb5-4695-8fbd-3dfdaa83e0e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:31.344605 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-96df7d31-9eb5-4695-8fbd-3dfdaa83e0e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:31.535921 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-96df7d31-9eb5-4695-8fbd-3dfdaa83e0e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:31.544562 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-96df7d31-9eb5-4695-8fbd-3dfdaa83e0e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1444 microversion: 2.1 time: 0.213657 Feb 28 19:18:31.545126 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 514/1031] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:31 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1444 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:31.560672 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b1caab1a-a4ec-472d-b018-a90a19c0ddd2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:18:31.561279 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b1caab1a-a4ec-472d-b018-a90a19c0ddd2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:18:31.568429 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1caab1a-a4ec-472d-b018-a90a19c0ddd2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:31.568867 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1caab1a-a4ec-472d-b018-a90a19c0ddd2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:31.569664 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1caab1a-a4ec-472d-b018-a90a19c0ddd2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:31.570095 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b1caab1a-a4ec-472d-b018-a90a19c0ddd2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:31.764961 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b1caab1a-a4ec-472d-b018-a90a19c0ddd2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:18:31.773862 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b1caab1a-a4ec-472d-b018-a90a19c0ddd2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1444 microversion: 2.1 time: 0.216621 Feb 28 19:18:31.774416 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 518/1032] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:18:31 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1444 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:18:34.544383 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-02a681a4-a580-4be6-8204-be6a6d88f43b req-b15c2efc-aac5-45f4-9081-f8505a6e3e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3da9bff-0b43-4aa3-acfd-fb44382d4999", "tag": "5d85a9de-2848-49e6-bde0-37a231102506"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:18:34.546037 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:18:34.546037 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:18:34.554552 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-02a681a4-a580-4be6-8204-be6a6d88f43b req-b15c2efc-aac5-45f4-9081-f8505a6e3e86 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:18:34.555083 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-02a681a4-a580-4be6-8204-be6a6d88f43b req-b15c2efc-aac5-45f4-9081-f8505a6e3e86 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:18:34.571007 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-02a681a4-a580-4be6-8204-be6a6d88f43b req-b15c2efc-aac5-45f4-9081-f8505a6e3e86 service nova] Creating event network-changed:5d85a9de-2848-49e6-bde0-37a231102506 for instance a3da9bff-0b43-4aa3-acfd-fb44382d4999 on hv-cinder-83118 Feb 28 19:18:34.575976 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-02a681a4-a580-4be6-8204-be6a6d88f43b req-b15c2efc-aac5-45f4-9081-f8505a6e3e86 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037054 Feb 28 19:18:34.576826 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 515/1033] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:19:01.945261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f5249a78-aa75-4229-bdf1-493debf23a05 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1618219625"}} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:19:01.945840 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f5249a78-aa75-4229-bdf1-493debf23a05 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:01.953722 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5249a78-aa75-4229-bdf1-493debf23a05 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:01.954165 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5249a78-aa75-4229-bdf1-493debf23a05 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:01.954930 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5249a78-aa75-4229-bdf1-493debf23a05 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:01.955386 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f5249a78-aa75-4229-bdf1-493debf23a05 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:02.143589 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.network.security_group_api [None req-f5249a78-aa75-4229-bdf1-493debf23a05 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Removing security group c2764f85-2f5b-4747-a36b-46a97d4d0b6a from port ec6aa0eb-a35d-4608-b76a-18b48ca9440f Feb 28 19:19:02.801306 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f5249a78-aa75-4229-bdf1-493debf23a05 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "POST /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/action" status: 202 len: 0 microversion: 2.1 time: 0.859652 Feb 28 19:19:02.817056 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 519/1034] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:19:01 2022] POST /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/action => generated 0 bytes in 876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:19:02.903050 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-026c15a3-8f8c-488d-9fb9-a8cb92c4b83b req-68e93177-585b-43fd-8091-7020a4376be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8a4f21-71cd-4cd7-97a0-7c534dfa826d", "tag": "ec6aa0eb-a35d-4608-b76a-18b48ca9440f"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:19:02.905538 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:19:02.905538 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:19:02.914991 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-026c15a3-8f8c-488d-9fb9-a8cb92c4b83b req-68e93177-585b-43fd-8091-7020a4376be1 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:02.915688 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-026c15a3-8f8c-488d-9fb9-a8cb92c4b83b req-68e93177-585b-43fd-8091-7020a4376be1 service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:02.934350 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-026c15a3-8f8c-488d-9fb9-a8cb92c4b83b req-68e93177-585b-43fd-8091-7020a4376be1 service nova] Creating event network-changed:ec6aa0eb-a35d-4608-b76a-18b48ca9440f for instance 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d on hv-cinder-83118 Feb 28 19:19:02.940154 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-026c15a3-8f8c-488d-9fb9-a8cb92c4b83b req-68e93177-585b-43fd-8091-7020a4376be1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130207 Feb 28 19:19:02.941333 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 516/1035] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:19:04.862648 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d5e9c61a-1976-4841-8ea2-f2aa56ad5222 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:04.863233 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d5e9c61a-1976-4841-8ea2-f2aa56ad5222 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:04.870566 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d5e9c61a-1976-4841-8ea2-f2aa56ad5222 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:04.871292 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d5e9c61a-1976-4841-8ea2-f2aa56ad5222 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:04.871981 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d5e9c61a-1976-4841-8ea2-f2aa56ad5222 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:04.872607 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d5e9c61a-1976-4841-8ea2-f2aa56ad5222 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:04.922415 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-88429036-a37f-4d7c-a009-a82c9f3cf1ad req-a9a3b9e2-070d-4192-ac9b-70174d53dbbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8a4f21-71cd-4cd7-97a0-7c534dfa826d", "tag": "ec6aa0eb-a35d-4608-b76a-18b48ca9440f"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:19:04.924472 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:19:04.924472 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:19:04.933061 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-88429036-a37f-4d7c-a009-a82c9f3cf1ad req-a9a3b9e2-070d-4192-ac9b-70174d53dbbc service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:04.933777 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-88429036-a37f-4d7c-a009-a82c9f3cf1ad req-a9a3b9e2-070d-4192-ac9b-70174d53dbbc service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:04.951689 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-88429036-a37f-4d7c-a009-a82c9f3cf1ad req-a9a3b9e2-070d-4192-ac9b-70174d53dbbc service nova] Creating event network-changed:ec6aa0eb-a35d-4608-b76a-18b48ca9440f for instance 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d on hv-cinder-83118 Feb 28 19:19:04.956813 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-88429036-a37f-4d7c-a009-a82c9f3cf1ad req-a9a3b9e2-070d-4192-ac9b-70174d53dbbc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095295 Feb 28 19:19:04.957968 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 517/1036] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 28 19:19:05.029819 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-d5e9c61a-1976-4841-8ea2-f2aa56ad5222 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lazy-loading 'services' on Instance uuid 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:19:05.301543 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d5e9c61a-1976-4841-8ea2-f2aa56ad5222 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments/4f29b9dc-e17e-4312-9bfc-3ddd7dc2632b" status: 202 len: 0 microversion: 2.1 time: 0.442603 Feb 28 19:19:05.305442 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 520/1037] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:19:04 2022] DELETE /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments/4f29b9dc-e17e-4312-9bfc-3ddd7dc2632b => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:19:05.312878 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a449ca0c-6bc7-42b8-af2e-5627d5ef985f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:05.313869 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a449ca0c-6bc7-42b8-af2e-5627d5ef985f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:05.322549 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a449ca0c-6bc7-42b8-af2e-5627d5ef985f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:05.323093 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a449ca0c-6bc7-42b8-af2e-5627d5ef985f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:05.324145 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a449ca0c-6bc7-42b8-af2e-5627d5ef985f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:05.324891 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a449ca0c-6bc7-42b8-af2e-5627d5ef985f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:05.390504 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a449ca0c-6bc7-42b8-af2e-5627d5ef985f tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083404 Feb 28 19:19:05.391567 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 518/1038] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:19:05 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:19:06.402670 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f08c8716-cc21-47a7-b95f-074e746c1fa6 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:06.403754 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f08c8716-cc21-47a7-b95f-074e746c1fa6 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:06.411524 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f08c8716-cc21-47a7-b95f-074e746c1fa6 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:06.411967 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f08c8716-cc21-47a7-b95f-074e746c1fa6 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:06.412742 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f08c8716-cc21-47a7-b95f-074e746c1fa6 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:06.413165 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f08c8716-cc21-47a7-b95f-074e746c1fa6 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:06.486484 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f08c8716-cc21-47a7-b95f-074e746c1fa6 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088251 Feb 28 19:19:06.487034 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 521/1039] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:19:06 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:19:07.498022 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a30cc522-d3de-43e2-8a3b-b2a4a2dbf561 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:07.498941 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a30cc522-d3de-43e2-8a3b-b2a4a2dbf561 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:07.506108 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a30cc522-d3de-43e2-8a3b-b2a4a2dbf561 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:07.506554 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a30cc522-d3de-43e2-8a3b-b2a4a2dbf561 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:07.507332 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a30cc522-d3de-43e2-8a3b-b2a4a2dbf561 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:07.507759 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a30cc522-d3de-43e2-8a3b-b2a4a2dbf561 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:07.571206 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a30cc522-d3de-43e2-8a3b-b2a4a2dbf561 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077557 Feb 28 19:19:07.571768 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 519/1040] 10.222.0.21 () {58 vars in 1301 bytes} [Mon Feb 28 19:19:07 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 28 19:19:07.582384 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2fbac0aa-6a8e-4382-93f3-f7af8b6fa85d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:07.582928 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-2fbac0aa-6a8e-4382-93f3-f7af8b6fa85d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:07.590497 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2fbac0aa-6a8e-4382-93f3-f7af8b6fa85d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:07.590938 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2fbac0aa-6a8e-4382-93f3-f7af8b6fa85d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:07.591735 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2fbac0aa-6a8e-4382-93f3-f7af8b6fa85d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:07.592160 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2fbac0aa-6a8e-4382-93f3-f7af8b6fa85d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:07.735730 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.wsgi [None req-2fbac0aa-6a8e-4382-93f3-f7af8b6fa85d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] HTTP exception thrown: Instance 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d is not attached to volume 4f29b9dc-e17e-4312-9bfc-3ddd7dc2632b Feb 28 19:19:07.736322 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2fbac0aa-6a8e-4382-93f3-f7af8b6fa85d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Returning 404 to user: Instance 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d is not attached to volume 4f29b9dc-e17e-4312-9bfc-3ddd7dc2632b {{(pid=101791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:19:07.737141 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2fbac0aa-6a8e-4382-93f3-f7af8b6fa85d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments/4f29b9dc-e17e-4312-9bfc-3ddd7dc2632b" status: 404 len: 154 microversion: 2.1 time: 0.158701 Feb 28 19:19:07.737687 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 522/1041] 10.222.0.21 () {58 vars in 1415 bytes} [Mon Feb 28 19:19:07 2022] DELETE /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d/os-volume_attachments/4f29b9dc-e17e-4312-9bfc-3ddd7dc2632b => generated 154 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:19:09.140733 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-029ba10a-1847-4f06-b06f-81178af80dff tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:09.141529 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-029ba10a-1847-4f06-b06f-81178af80dff tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:09.148498 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-029ba10a-1847-4f06-b06f-81178af80dff tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:09.156540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-029ba10a-1847-4f06-b06f-81178af80dff tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:09.156540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-029ba10a-1847-4f06-b06f-81178af80dff tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:09.156540 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-029ba10a-1847-4f06-b06f-81178af80dff tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:09.212852 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-029ba10a-1847-4f06-b06f-81178af80dff tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Going to try to terminate instance {{(pid=101792) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:19:09.509561 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-029ba10a-1847-4f06-b06f-81178af80dff tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "DELETE /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 204 len: 0 microversion: 2.1 time: 0.372329 Feb 28 19:19:09.510173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 520/1042] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:19:09 2022] DELETE /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:19:09.519210 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2a81a8a4-801d-4957-96ae-c3ec137c4524 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:09.519823 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-2a81a8a4-801d-4957-96ae-c3ec137c4524 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:09.529010 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a81a8a4-801d-4957-96ae-c3ec137c4524 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:09.529453 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a81a8a4-801d-4957-96ae-c3ec137c4524 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:09.530225 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a81a8a4-801d-4957-96ae-c3ec137c4524 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:09.530655 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2a81a8a4-801d-4957-96ae-c3ec137c4524 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:09.722706 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-2a81a8a4-801d-4957-96ae-c3ec137c4524 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:19:09.730807 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2a81a8a4-801d-4957-96ae-c3ec137c4524 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1556 microversion: 2.1 time: 0.215723 Feb 28 19:19:09.731457 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 523/1043] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:19:09 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1556 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:19:10.748777 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-1d9c6a2d-1dd8-4a90-abbe-09b9b21de10d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:10.749468 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-1d9c6a2d-1dd8-4a90-abbe-09b9b21de10d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:10.756774 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1d9c6a2d-1dd8-4a90-abbe-09b9b21de10d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:10.757222 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1d9c6a2d-1dd8-4a90-abbe-09b9b21de10d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:10.757981 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1d9c6a2d-1dd8-4a90-abbe-09b9b21de10d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:10.758409 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-1d9c6a2d-1dd8-4a90-abbe-09b9b21de10d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:10.954623 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-1d9c6a2d-1dd8-4a90-abbe-09b9b21de10d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:19:10.962992 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-1d9c6a2d-1dd8-4a90-abbe-09b9b21de10d tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1556 microversion: 2.1 time: 0.218508 Feb 28 19:19:10.965043 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 521/1044] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:19:10 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1556 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:19:11.982024 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-c144286f-b001-402d-aa13-cb33c099c906 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:11.982735 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-c144286f-b001-402d-aa13-cb33c099c906 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:11.990184 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c144286f-b001-402d-aa13-cb33c099c906 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:11.990741 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c144286f-b001-402d-aa13-cb33c099c906 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:11.991559 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c144286f-b001-402d-aa13-cb33c099c906 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:11.991996 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-c144286f-b001-402d-aa13-cb33c099c906 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:12.250347 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-c144286f-b001-402d-aa13-cb33c099c906 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:19:12.258582 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-c144286f-b001-402d-aa13-cb33c099c906 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1556 microversion: 2.1 time: 0.281457 Feb 28 19:19:12.262355 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 524/1045] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:19:11 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1556 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:19:12.396577 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-a54fa3d4-0e03-44e6-9add-6a68064ab7bf req-b826d98b-dbf3-4424-94d7-8d42405a795f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8a4f21-71cd-4cd7-97a0-7c534dfa826d", "name": "network-vif-deleted", "tag": "ec6aa0eb-a35d-4608-b76a-18b48ca9440f"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:19:12.398237 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:19:12.398237 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:19:12.406846 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-a54fa3d4-0e03-44e6-9add-6a68064ab7bf req-b826d98b-dbf3-4424-94d7-8d42405a795f service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:12.407241 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-a54fa3d4-0e03-44e6-9add-6a68064ab7bf req-b826d98b-dbf3-4424-94d7-8d42405a795f service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:12.422793 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-a54fa3d4-0e03-44e6-9add-6a68064ab7bf req-b826d98b-dbf3-4424-94d7-8d42405a795f service nova] Creating event network-vif-deleted:ec6aa0eb-a35d-4608-b76a-18b48ca9440f for instance 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d on hv-cinder-83118 Feb 28 19:19:12.427547 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-a54fa3d4-0e03-44e6-9add-6a68064ab7bf req-b826d98b-dbf3-4424-94d7-8d42405a795f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034603 Feb 28 19:19:12.428104 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 522/1046] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:19:13.275992 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-44572e17-c5bc-42ef-a8f9-6740501fcf41 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:13.276617 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-44572e17-c5bc-42ef-a8f9-6740501fcf41 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:13.284117 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-44572e17-c5bc-42ef-a8f9-6740501fcf41 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:13.284567 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-44572e17-c5bc-42ef-a8f9-6740501fcf41 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:13.285338 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-44572e17-c5bc-42ef-a8f9-6740501fcf41 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:13.285770 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-44572e17-c5bc-42ef-a8f9-6740501fcf41 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:13.352082 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-44572e17-c5bc-42ef-a8f9-6740501fcf41 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:13.352522 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-44572e17-c5bc-42ef-a8f9-6740501fcf41 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:13.352966 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.objects.instance [None req-44572e17-c5bc-42ef-a8f9-6740501fcf41 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lazy-loading 'fault' on Instance uuid 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d {{(pid=101791) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:19:13.509789 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-44572e17-c5bc-42ef-a8f9-6740501fcf41 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3aec60992f441d8f8370f3beafe080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f298627f53d14c5d92595dd3a87578d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:19:13.517827 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-44572e17-c5bc-42ef-a8f9-6740501fcf41 tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 200 len: 1349 microversion: 2.1 time: 0.245687 Feb 28 19:19:13.518481 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 525/1047] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:19:13 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 1349 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:19:14.535279 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e7a3bc7b-40c6-4dbd-abdd-f3b40608817c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:14.535971 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e7a3bc7b-40c6-4dbd-abdd-f3b40608817c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] [instance: 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:19:14.543369 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7a3bc7b-40c6-4dbd-abdd-f3b40608817c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:14.543814 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7a3bc7b-40c6-4dbd-abdd-f3b40608817c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:14.544573 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7a3bc7b-40c6-4dbd-abdd-f3b40608817c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:19:14.545001 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e7a3bc7b-40c6-4dbd-abdd-f3b40608817c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:19:14.596185 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-e7a3bc7b-40c6-4dbd-abdd-f3b40608817c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] HTTP exception thrown: Instance 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d could not be found. Feb 28 19:19:14.596773 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e7a3bc7b-40c6-4dbd-abdd-f3b40608817c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Returning 404 to user: Instance 6d8a4f21-71cd-4cd7-97a0-7c534dfa826d could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:19:14.597579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e7a3bc7b-40c6-4dbd-abdd-f3b40608817c tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d" status: 404 len: 111 microversion: 2.1 time: 0.066460 Feb 28 19:19:14.598108 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 523/1048] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:19:14 2022] GET /compute/v2.1/servers/6d8a4f21-71cd-4cd7-97a0-7c534dfa826d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:19:14.606085 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a0fc9feb-c227-43f7-ab77-9ffc22b17c1b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] Calling method '.version_select at 0x7f912f7e15e0>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:19:14.679700 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a0fc9feb-c227-43f7-ab77-9ffc22b17c1b tempest-TestMinimumBasicScenario-740587523 tempest-TestMinimumBasicScenario-740587523-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1289578035" status: 202 len: 0 microversion: 2.1 time: 0.077166 Feb 28 19:19:14.680251 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 526/1049] 10.222.0.21 () {58 vars in 1271 bytes} [Mon Feb 28 19:19:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1289578035 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:20:20.907747 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:20:20.908380 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: Mon Feb 28 19:20:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:20:48.668737 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-0dcdb05b-ca2e-4d31-ba3d-eaa771b36e3a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:20:48.669442 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-0dcdb05b-ca2e-4d31-ba3d-eaa771b36e3a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:20:48.676541 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0dcdb05b-ca2e-4d31-ba3d-eaa771b36e3a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:48.676992 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0dcdb05b-ca2e-4d31-ba3d-eaa771b36e3a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:48.677752 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0dcdb05b-ca2e-4d31-ba3d-eaa771b36e3a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:48.678181 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-0dcdb05b-ca2e-4d31-ba3d-eaa771b36e3a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:48.734780 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.objects.instance [None req-0dcdb05b-ca2e-4d31-ba3d-eaa771b36e3a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lazy-loading 'flavor' on Instance uuid a3da9bff-0b43-4aa3-acfd-fb44382d4999 {{(pid=101792) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Feb 28 19:20:49.085294 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-0dcdb05b-ca2e-4d31-ba3d-eaa771b36e3a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "POST /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999/action" status: 202 len: 0 microversion: 2.1 time: 0.420521 Feb 28 19:20:49.085928 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 524/1050] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:20:48 2022] POST /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:20:49.094788 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-12d2a2eb-636b-4323-bc0d-88155f89765b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:20:49.095514 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-12d2a2eb-636b-4323-bc0d-88155f89765b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:20:49.098966 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: ERROR oslo.messaging._drivers.impl_rabbit [-] [295cd133-f5a7-4657-b76e-4933c04695f5] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 28 19:20:49.103923 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-12d2a2eb-636b-4323-bc0d-88155f89765b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:49.104369 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-12d2a2eb-636b-4323-bc0d-88155f89765b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:49.105163 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-12d2a2eb-636b-4323-bc0d-88155f89765b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:49.105792 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-12d2a2eb-636b-4323-bc0d-88155f89765b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:49.301487 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-12d2a2eb-636b-4323-bc0d-88155f89765b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:20:49.310053 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-12d2a2eb-636b-4323-bc0d-88155f89765b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.219093 Feb 28 19:20:49.310613 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 527/1051] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:20:49 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:20:50.328408 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-b4d29cb5-710a-4c3b-9e41-48440a475e8d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:20:50.329052 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-b4d29cb5-710a-4c3b-9e41-48440a475e8d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:20:50.336408 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b4d29cb5-710a-4c3b-9e41-48440a475e8d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:50.336854 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b4d29cb5-710a-4c3b-9e41-48440a475e8d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:50.337612 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b4d29cb5-710a-4c3b-9e41-48440a475e8d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:50.338043 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-b4d29cb5-710a-4c3b-9e41-48440a475e8d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:50.532633 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-b4d29cb5-710a-4c3b-9e41-48440a475e8d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:20:50.540812 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-b4d29cb5-710a-4c3b-9e41-48440a475e8d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.216952 Feb 28 19:20:50.541376 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 525/1052] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:20:50 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:20:51.557614 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4603104a-eb4a-463a-b754-cae48bad5f42 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:20:51.558231 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4603104a-eb4a-463a-b754-cae48bad5f42 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:20:51.567893 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4603104a-eb4a-463a-b754-cae48bad5f42 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:51.568340 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4603104a-eb4a-463a-b754-cae48bad5f42 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:51.569142 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4603104a-eb4a-463a-b754-cae48bad5f42 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:51.569581 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4603104a-eb4a-463a-b754-cae48bad5f42 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:51.607859 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] [295cd133-f5a7-4657-b76e-4933c04695f5] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 39454. Feb 28 19:20:51.769813 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4603104a-eb4a-463a-b754-cae48bad5f42 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:20:51.778130 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4603104a-eb4a-463a-b754-cae48bad5f42 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.224220 Feb 28 19:20:51.778724 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 528/1053] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:20:51 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:20:52.794399 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-2bd8c8f0-ba11-46cc-bfc2-0d9bba9e414f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:20:52.794999 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-2bd8c8f0-ba11-46cc-bfc2-0d9bba9e414f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:20:52.802481 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2bd8c8f0-ba11-46cc-bfc2-0d9bba9e414f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:52.802929 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2bd8c8f0-ba11-46cc-bfc2-0d9bba9e414f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:52.803733 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2bd8c8f0-ba11-46cc-bfc2-0d9bba9e414f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:52.804173 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-2bd8c8f0-ba11-46cc-bfc2-0d9bba9e414f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:53.123447 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-2bd8c8f0-ba11-46cc-bfc2-0d9bba9e414f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:20:53.131577 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-2bd8c8f0-ba11-46cc-bfc2-0d9bba9e414f tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.340921 Feb 28 19:20:53.132138 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 526/1054] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:20:52 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:20:54.149644 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-b4643b6a-4424-4a6b-aaf4-96a0d8f03094 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:20:54.150256 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-b4643b6a-4424-4a6b-aaf4-96a0d8f03094 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:20:54.158255 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b4643b6a-4424-4a6b-aaf4-96a0d8f03094 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:54.158698 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b4643b6a-4424-4a6b-aaf4-96a0d8f03094 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:54.159479 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b4643b6a-4424-4a6b-aaf4-96a0d8f03094 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:54.159903 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-b4643b6a-4424-4a6b-aaf4-96a0d8f03094 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:54.348868 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-b4643b6a-4424-4a6b-aaf4-96a0d8f03094 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:20:54.357828 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-b4643b6a-4424-4a6b-aaf4-96a0d8f03094 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.211867 Feb 28 19:20:54.358382 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 529/1055] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:20:54 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:20:55.375374 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-efa74584-4aff-41a3-b06c-f0bc71a41284 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:20:55.375908 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-efa74584-4aff-41a3-b06c-f0bc71a41284 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:20:55.383239 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-efa74584-4aff-41a3-b06c-f0bc71a41284 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:55.383686 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-efa74584-4aff-41a3-b06c-f0bc71a41284 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:55.384455 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-efa74584-4aff-41a3-b06c-f0bc71a41284 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:55.384886 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-efa74584-4aff-41a3-b06c-f0bc71a41284 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:55.576466 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-efa74584-4aff-41a3-b06c-f0bc71a41284 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:20:55.584905 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-efa74584-4aff-41a3-b06c-f0bc71a41284 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.214049 Feb 28 19:20:55.585462 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 527/1056] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:20:55 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:20:56.601587 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a64a009a-191a-4c47-b997-2f77c38c66c0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:20:56.602225 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a64a009a-191a-4c47-b997-2f77c38c66c0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:20:56.609593 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a64a009a-191a-4c47-b997-2f77c38c66c0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:56.610028 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a64a009a-191a-4c47-b997-2f77c38c66c0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:56.610782 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a64a009a-191a-4c47-b997-2f77c38c66c0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:56.611242 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a64a009a-191a-4c47-b997-2f77c38c66c0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:56.900668 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a64a009a-191a-4c47-b997-2f77c38c66c0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:20:56.909377 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a64a009a-191a-4c47-b997-2f77c38c66c0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.311433 Feb 28 19:20:56.909925 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 530/1057] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:20:56 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:20:57.926536 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-954e6a25-7b1b-4f08-867f-5ef7511913e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:20:57.927170 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-954e6a25-7b1b-4f08-867f-5ef7511913e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:20:57.935002 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-954e6a25-7b1b-4f08-867f-5ef7511913e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:57.936137 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-954e6a25-7b1b-4f08-867f-5ef7511913e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:57.936271 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-954e6a25-7b1b-4f08-867f-5ef7511913e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:57.936727 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-954e6a25-7b1b-4f08-867f-5ef7511913e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:58.139891 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-954e6a25-7b1b-4f08-867f-5ef7511913e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:20:58.148017 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-954e6a25-7b1b-4f08-867f-5ef7511913e3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.225139 Feb 28 19:20:58.148579 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 528/1058] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:20:57 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:20:59.165652 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-2ad19b03-e101-4dd6-9d4e-75cbe242f84d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:20:59.166293 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-2ad19b03-e101-4dd6-9d4e-75cbe242f84d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:20:59.173625 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2ad19b03-e101-4dd6-9d4e-75cbe242f84d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:59.174066 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2ad19b03-e101-4dd6-9d4e-75cbe242f84d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:59.174827 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2ad19b03-e101-4dd6-9d4e-75cbe242f84d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:20:59.175292 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-2ad19b03-e101-4dd6-9d4e-75cbe242f84d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:20:59.374736 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-2ad19b03-e101-4dd6-9d4e-75cbe242f84d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:20:59.383018 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-2ad19b03-e101-4dd6-9d4e-75cbe242f84d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.221104 Feb 28 19:20:59.383617 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 531/1059] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:20:59 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:00.400914 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-a2bdf061-4170-451e-a5a6-6672033db6b1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:00.401521 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-a2bdf061-4170-451e-a5a6-6672033db6b1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:00.409335 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2bdf061-4170-451e-a5a6-6672033db6b1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:00.409775 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2bdf061-4170-451e-a5a6-6672033db6b1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:00.410526 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2bdf061-4170-451e-a5a6-6672033db6b1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:00.410955 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-a2bdf061-4170-451e-a5a6-6672033db6b1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:00.602980 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-a2bdf061-4170-451e-a5a6-6672033db6b1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:00.611605 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-a2bdf061-4170-451e-a5a6-6672033db6b1 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.214378 Feb 28 19:21:00.612166 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 529/1060] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:00 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:01.628383 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-3c9dbb9e-bcb0-4de0-976c-82943292c219 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:01.628993 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-3c9dbb9e-bcb0-4de0-976c-82943292c219 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:01.636165 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3c9dbb9e-bcb0-4de0-976c-82943292c219 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:01.636814 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3c9dbb9e-bcb0-4de0-976c-82943292c219 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:01.637874 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3c9dbb9e-bcb0-4de0-976c-82943292c219 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:01.638261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-3c9dbb9e-bcb0-4de0-976c-82943292c219 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:01.827047 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-3c9dbb9e-bcb0-4de0-976c-82943292c219 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:01.835088 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-3c9dbb9e-bcb0-4de0-976c-82943292c219 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.210421 Feb 28 19:21:01.835657 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 532/1061] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:01 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:02.852182 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e03c2de4-23b0-4faf-8f53-a18413ddbbe7 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:02.852846 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e03c2de4-23b0-4faf-8f53-a18413ddbbe7 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:02.860082 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e03c2de4-23b0-4faf-8f53-a18413ddbbe7 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:02.860532 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e03c2de4-23b0-4faf-8f53-a18413ddbbe7 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:02.861297 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e03c2de4-23b0-4faf-8f53-a18413ddbbe7 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:02.861729 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e03c2de4-23b0-4faf-8f53-a18413ddbbe7 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:03.059652 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e03c2de4-23b0-4faf-8f53-a18413ddbbe7 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:03.067745 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e03c2de4-23b0-4faf-8f53-a18413ddbbe7 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.219342 Feb 28 19:21:03.068308 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 530/1062] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:02 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:04.084824 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-884715d0-11a2-4b5f-a54e-1b897055ccbb tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:04.085430 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-884715d0-11a2-4b5f-a54e-1b897055ccbb tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:04.093189 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-884715d0-11a2-4b5f-a54e-1b897055ccbb tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:04.093629 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-884715d0-11a2-4b5f-a54e-1b897055ccbb tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:04.094386 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-884715d0-11a2-4b5f-a54e-1b897055ccbb tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:04.094817 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-884715d0-11a2-4b5f-a54e-1b897055ccbb tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:04.288218 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-884715d0-11a2-4b5f-a54e-1b897055ccbb tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:04.298042 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-884715d0-11a2-4b5f-a54e-1b897055ccbb tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.216893 Feb 28 19:21:04.298602 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 533/1063] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:04 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:05.315512 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e38f0cbc-2cfb-4207-b03d-ebfd5fbf55d9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:05.316071 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e38f0cbc-2cfb-4207-b03d-ebfd5fbf55d9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:05.323300 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e38f0cbc-2cfb-4207-b03d-ebfd5fbf55d9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:05.323750 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e38f0cbc-2cfb-4207-b03d-ebfd5fbf55d9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:05.324597 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e38f0cbc-2cfb-4207-b03d-ebfd5fbf55d9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:05.324991 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e38f0cbc-2cfb-4207-b03d-ebfd5fbf55d9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:05.516798 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e38f0cbc-2cfb-4207-b03d-ebfd5fbf55d9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:05.524971 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e38f0cbc-2cfb-4207-b03d-ebfd5fbf55d9 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.213241 Feb 28 19:21:05.525530 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 531/1064] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:05 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:06.541861 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-a5b55e79-c9f9-4708-bffc-ada3b12481e4 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:06.542471 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-a5b55e79-c9f9-4708-bffc-ada3b12481e4 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:06.550420 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5b55e79-c9f9-4708-bffc-ada3b12481e4 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:06.550871 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5b55e79-c9f9-4708-bffc-ada3b12481e4 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:06.551675 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5b55e79-c9f9-4708-bffc-ada3b12481e4 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:06.552110 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-a5b55e79-c9f9-4708-bffc-ada3b12481e4 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:06.751350 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-a5b55e79-c9f9-4708-bffc-ada3b12481e4 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:06.759578 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-a5b55e79-c9f9-4708-bffc-ada3b12481e4 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.221736 Feb 28 19:21:06.760146 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 534/1065] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:06 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:07.776754 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-10af0603-a634-49c0-b1a7-db868058d59d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:07.777468 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-10af0603-a634-49c0-b1a7-db868058d59d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:07.784714 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-10af0603-a634-49c0-b1a7-db868058d59d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:07.788981 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-10af0603-a634-49c0-b1a7-db868058d59d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:07.788981 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-10af0603-a634-49c0-b1a7-db868058d59d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:07.788981 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-10af0603-a634-49c0-b1a7-db868058d59d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:07.983003 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-10af0603-a634-49c0-b1a7-db868058d59d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:07.991244 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-10af0603-a634-49c0-b1a7-db868058d59d tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1570 microversion: 2.1 time: 0.218266 Feb 28 19:21:07.991797 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 532/1066] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:07 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1570 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:08.007213 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-d31a5482-8c73-46bf-92dc-f8d36e35e7a0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:21:08.007776 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-d31a5482-8c73-46bf-92dc-f8d36e35e7a0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:08.015338 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d31a5482-8c73-46bf-92dc-f8d36e35e7a0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:08.015781 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d31a5482-8c73-46bf-92dc-f8d36e35e7a0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:08.016543 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d31a5482-8c73-46bf-92dc-f8d36e35e7a0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:08.016969 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-d31a5482-8c73-46bf-92dc-f8d36e35e7a0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:08.338627 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-d31a5482-8c73-46bf-92dc-f8d36e35e7a0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "POST /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999/action" status: 202 len: 0 microversion: 2.1 time: 0.334847 Feb 28 19:21:08.339261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 535/1067] 10.222.0.21 () {60 vars in 1277 bytes} [Mon Feb 28 19:21:08 2022] POST /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:21:08.347846 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-e40ac34f-e385-4b1f-85cb-6565d4d6c89b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:08.348583 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-e40ac34f-e385-4b1f-85cb-6565d4d6c89b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:08.355977 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e40ac34f-e385-4b1f-85cb-6565d4d6c89b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:08.356423 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e40ac34f-e385-4b1f-85cb-6565d4d6c89b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:08.357191 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e40ac34f-e385-4b1f-85cb-6565d4d6c89b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:08.357621 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-e40ac34f-e385-4b1f-85cb-6565d4d6c89b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:08.654774 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-e40ac34f-e385-4b1f-85cb-6565d4d6c89b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:08.663359 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-e40ac34f-e385-4b1f-85cb-6565d4d6c89b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1518 microversion: 2.1 time: 0.319676 Feb 28 19:21:08.663930 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 533/1068] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:08 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1518 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:09.462760 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [req-5ac98cd2-d8dc-4aa2-a2c9-a6883fe348b5 req-f3ab3060-b370-431c-8732-a37a219de0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3da9bff-0b43-4aa3-acfd-fb44382d4999", "name": "network-vif-unplugged", "status": "completed", "tag": "5d85a9de-2848-49e6-bde0-37a231102506"}]} {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:21:09.464317 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:21:09.464317 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: warnings.warn(msg) Feb 28 19:21:09.472909 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-5ac98cd2-d8dc-4aa2-a2c9-a6883fe348b5 req-f3ab3060-b370-431c-8732-a37a219de0bb service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:09.473328 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [req-5ac98cd2-d8dc-4aa2-a2c9-a6883fe348b5 req-f3ab3060-b370-431c-8732-a37a219de0bb service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:09.490196 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.compute.server_external_events [req-5ac98cd2-d8dc-4aa2-a2c9-a6883fe348b5 req-f3ab3060-b370-431c-8732-a37a219de0bb service nova] Unable to find a host for instance a3da9bff-0b43-4aa3-acfd-fb44382d4999. Dropping event network-vif-unplugged {{(pid=101791) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 28 19:21:09.491002 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [req-5ac98cd2-d8dc-4aa2-a2c9-a6883fe348b5 req-f3ab3060-b370-431c-8732-a37a219de0bb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032320 Feb 28 19:21:09.491904 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 536/1069] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 28 19:21:09.680439 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-c37e928a-0e33-41fd-a19c-a955e977aa79 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:09.681064 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-c37e928a-0e33-41fd-a19c-a955e977aa79 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:09.688462 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c37e928a-0e33-41fd-a19c-a955e977aa79 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:09.688913 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c37e928a-0e33-41fd-a19c-a955e977aa79 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:09.689687 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c37e928a-0e33-41fd-a19c-a955e977aa79 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:09.690119 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-c37e928a-0e33-41fd-a19c-a955e977aa79 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:09.889644 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-c37e928a-0e33-41fd-a19c-a955e977aa79 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:09.897712 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-c37e928a-0e33-41fd-a19c-a955e977aa79 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1520 microversion: 2.1 time: 0.220982 Feb 28 19:21:09.898274 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 534/1070] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:09 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:10.921781 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-36ece210-7d00-43ca-8794-84ed621df47b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:10.922409 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-36ece210-7d00-43ca-8794-84ed621df47b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:10.929961 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36ece210-7d00-43ca-8794-84ed621df47b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:10.930405 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36ece210-7d00-43ca-8794-84ed621df47b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:10.931186 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36ece210-7d00-43ca-8794-84ed621df47b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:10.931619 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-36ece210-7d00-43ca-8794-84ed621df47b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:11.223739 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-36ece210-7d00-43ca-8794-84ed621df47b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:11.232359 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-36ece210-7d00-43ca-8794-84ed621df47b tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1576 microversion: 2.1 time: 0.314874 Feb 28 19:21:11.232926 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 537/1071] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:10 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1576 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:12.247840 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0ff264c-44f7-4e38-951f-4edc98ed008f] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 28 19:21:12.251076 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-7d973e33-5c34-4bc9-a219-5797becba8b2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:12.251691 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-7d973e33-5c34-4bc9-a219-5797becba8b2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:12.259015 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d973e33-5c34-4bc9-a219-5797becba8b2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:12.259493 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d973e33-5c34-4bc9-a219-5797becba8b2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:12.260254 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d973e33-5c34-4bc9-a219-5797becba8b2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:12.260688 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-7d973e33-5c34-4bc9-a219-5797becba8b2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:12.459050 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-7d973e33-5c34-4bc9-a219-5797becba8b2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:12.466123 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-7d973e33-5c34-4bc9-a219-5797becba8b2 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1576 microversion: 2.1 time: 0.219213 Feb 28 19:21:12.466699 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 535/1072] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:12 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:13.483416 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6565a1e5-be44-4a02-aea5-957d3ca116fd tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:13.484022 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-6565a1e5-be44-4a02-aea5-957d3ca116fd tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:13.491291 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6565a1e5-be44-4a02-aea5-957d3ca116fd tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:13.491731 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6565a1e5-be44-4a02-aea5-957d3ca116fd tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:13.492517 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6565a1e5-be44-4a02-aea5-957d3ca116fd tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:13.492942 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6565a1e5-be44-4a02-aea5-957d3ca116fd tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:13.685142 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6565a1e5-be44-4a02-aea5-957d3ca116fd tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:13.694451 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6565a1e5-be44-4a02-aea5-957d3ca116fd tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1576 microversion: 2.1 time: 0.215220 Feb 28 19:21:13.695007 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 538/1073] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:13 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:14.711416 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-d1608c5b-b515-495c-8d67-6c54e12a3da8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:14.712032 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-d1608c5b-b515-495c-8d67-6c54e12a3da8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:14.720822 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d1608c5b-b515-495c-8d67-6c54e12a3da8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:14.721261 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d1608c5b-b515-495c-8d67-6c54e12a3da8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:14.722032 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d1608c5b-b515-495c-8d67-6c54e12a3da8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:14.722459 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-d1608c5b-b515-495c-8d67-6c54e12a3da8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:14.756808 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0ff264c-44f7-4e38-951f-4edc98ed008f] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 39510. Feb 28 19:21:14.918837 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-d1608c5b-b515-495c-8d67-6c54e12a3da8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:14.927634 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-d1608c5b-b515-495c-8d67-6c54e12a3da8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1576 microversion: 2.1 time: 0.219852 Feb 28 19:21:14.928200 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 536/1074] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:14 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:15.948441 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4d1741fa-f9ac-4e12-8da7-17ea266d88ba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:15.949046 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-4d1741fa-f9ac-4e12-8da7-17ea266d88ba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:15.957198 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4d1741fa-f9ac-4e12-8da7-17ea266d88ba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:15.958384 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4d1741fa-f9ac-4e12-8da7-17ea266d88ba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:15.958497 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4d1741fa-f9ac-4e12-8da7-17ea266d88ba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:15.958915 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-4d1741fa-f9ac-4e12-8da7-17ea266d88ba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:16.156934 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-4d1741fa-f9ac-4e12-8da7-17ea266d88ba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:16.164967 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4d1741fa-f9ac-4e12-8da7-17ea266d88ba tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1576 microversion: 2.1 time: 0.220122 Feb 28 19:21:16.165462 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 539/1075] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:15 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:17.181580 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8406bf58-6416-4df7-88fa-f2f629d889a3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:17.182182 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8406bf58-6416-4df7-88fa-f2f629d889a3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:17.190175 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8406bf58-6416-4df7-88fa-f2f629d889a3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:17.190614 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8406bf58-6416-4df7-88fa-f2f629d889a3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:17.191390 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8406bf58-6416-4df7-88fa-f2f629d889a3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:17.191820 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8406bf58-6416-4df7-88fa-f2f629d889a3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:17.386013 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8406bf58-6416-4df7-88fa-f2f629d889a3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:17.394462 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8406bf58-6416-4df7-88fa-f2f629d889a3 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1576 microversion: 2.1 time: 0.216567 Feb 28 19:21:17.395018 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 537/1076] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:17 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:18.411492 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-6cb156f0-c3a0-4e7e-898d-5e5c725b125a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:18.412089 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-6cb156f0-c3a0-4e7e-898d-5e5c725b125a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:18.419412 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6cb156f0-c3a0-4e7e-898d-5e5c725b125a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:18.420587 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6cb156f0-c3a0-4e7e-898d-5e5c725b125a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:18.421351 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6cb156f0-c3a0-4e7e-898d-5e5c725b125a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:18.421777 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-6cb156f0-c3a0-4e7e-898d-5e5c725b125a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:18.705341 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-6cb156f0-c3a0-4e7e-898d-5e5c725b125a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:18.713393 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-6cb156f0-c3a0-4e7e-898d-5e5c725b125a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1576 microversion: 2.1 time: 0.305587 Feb 28 19:21:18.713947 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 540/1077] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:18 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1576 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:19.730911 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-8d058e1f-9cc1-4f2c-b186-e227f1e9d905 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:19.731545 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-8d058e1f-9cc1-4f2c-b186-e227f1e9d905 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:19.739348 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d058e1f-9cc1-4f2c-b186-e227f1e9d905 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:19.739795 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d058e1f-9cc1-4f2c-b186-e227f1e9d905 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:19.740551 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d058e1f-9cc1-4f2c-b186-e227f1e9d905 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:19.740979 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-8d058e1f-9cc1-4f2c-b186-e227f1e9d905 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:19.935917 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-8d058e1f-9cc1-4f2c-b186-e227f1e9d905 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:19.944169 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-8d058e1f-9cc1-4f2c-b186-e227f1e9d905 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1576 microversion: 2.1 time: 0.216943 Feb 28 19:21:19.944733 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 538/1078] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:19 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:20.961110 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-f8644d3f-a2fc-4877-9d6d-c6bba9ef1b9e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:20.961779 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-f8644d3f-a2fc-4877-9d6d-c6bba9ef1b9e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:20.969179 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f8644d3f-a2fc-4877-9d6d-c6bba9ef1b9e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:20.969627 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f8644d3f-a2fc-4877-9d6d-c6bba9ef1b9e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:20.970393 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f8644d3f-a2fc-4877-9d6d-c6bba9ef1b9e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:20.970829 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-f8644d3f-a2fc-4877-9d6d-c6bba9ef1b9e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:21.175820 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-f8644d3f-a2fc-4877-9d6d-c6bba9ef1b9e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:21.183803 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-f8644d3f-a2fc-4877-9d6d-c6bba9ef1b9e tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1576 microversion: 2.1 time: 0.226456 Feb 28 19:21:21.184357 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 541/1079] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:20 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:21.608079 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-9f4395b9-5b40-4aad-87db-303c3f67ed46 req-2f13a959-7803-43ce-a0ec-f2dd8df8310f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3da9bff-0b43-4aa3-acfd-fb44382d4999", "name": "network-vif-plugged", "status": "completed", "tag": "5d85a9de-2848-49e6-bde0-37a231102506"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:21:21.610197 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:21:21.610197 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:21:21.618212 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-9f4395b9-5b40-4aad-87db-303c3f67ed46 req-2f13a959-7803-43ce-a0ec-f2dd8df8310f service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:21.620228 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-9f4395b9-5b40-4aad-87db-303c3f67ed46 req-2f13a959-7803-43ce-a0ec-f2dd8df8310f service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:21.633881 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-9f4395b9-5b40-4aad-87db-303c3f67ed46 req-2f13a959-7803-43ce-a0ec-f2dd8df8310f service nova] Creating event network-vif-plugged:5d85a9de-2848-49e6-bde0-37a231102506 for instance a3da9bff-0b43-4aa3-acfd-fb44382d4999 on hv-cinder-83118 Feb 28 19:21:21.638990 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-9f4395b9-5b40-4aad-87db-303c3f67ed46 req-2f13a959-7803-43ce-a0ec-f2dd8df8310f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034568 Feb 28 19:21:21.639614 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 539/1080] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:21:22.201802 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-96ce5923-118d-4dd6-8a16-9bcb13008e85 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:22.202418 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-96ce5923-118d-4dd6-8a16-9bcb13008e85 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:22.209635 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-96ce5923-118d-4dd6-8a16-9bcb13008e85 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:22.210083 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-96ce5923-118d-4dd6-8a16-9bcb13008e85 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:22.210850 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-96ce5923-118d-4dd6-8a16-9bcb13008e85 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:22.211320 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-96ce5923-118d-4dd6-8a16-9bcb13008e85 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:22.401904 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-96ce5923-118d-4dd6-8a16-9bcb13008e85 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:22.409974 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-96ce5923-118d-4dd6-8a16-9bcb13008e85 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1576 microversion: 2.1 time: 0.212702 Feb 28 19:21:22.410527 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 542/1081] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:22 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:23.427417 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-4b030152-bc67-468c-95e1-66c59cb58f6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:21:23.428120 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-4b030152-bc67-468c-95e1-66c59cb58f6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:21:23.435625 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4b030152-bc67-468c-95e1-66c59cb58f6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:23.436073 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4b030152-bc67-468c-95e1-66c59cb58f6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:23.436904 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4b030152-bc67-468c-95e1-66c59cb58f6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:21:23.437338 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-4b030152-bc67-468c-95e1-66c59cb58f6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:21:23.634258 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-4b030152-bc67-468c-95e1-66c59cb58f6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:21:23.643617 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-4b030152-bc67-468c-95e1-66c59cb58f6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1563 microversion: 2.1 time: 0.220515 Feb 28 19:21:23.644190 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 540/1082] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:21:23 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1563 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:21:42.657441 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:21:42.658186 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: Mon Feb 28 19:21:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:21:59.513922 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:21:59.514500 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: Mon Feb 28 19:21:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:22:03.012558 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:22:03.013152 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: Mon Feb 28 19:22:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:22:52.547153 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-37b591b1-dd84-4d36-8ed4-deced0b76df0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:22:52.548737 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-37b591b1-dd84-4d36-8ed4-deced0b76df0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:22:52.551837 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-8a52b3f3-eeb8-4fa0-b878-14da0c4f7df6 req-40d15a4e-25f2-4eae-af41-74f206b5785e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3da9bff-0b43-4aa3-acfd-fb44382d4999", "tag": "5d85a9de-2848-49e6-bde0-37a231102506"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:22:52.553360 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:22:52.553360 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:22:52.555714 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-37b591b1-dd84-4d36-8ed4-deced0b76df0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:52.556168 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-37b591b1-dd84-4d36-8ed4-deced0b76df0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:52.556956 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-37b591b1-dd84-4d36-8ed4-deced0b76df0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:52.557454 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-37b591b1-dd84-4d36-8ed4-deced0b76df0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:52.562344 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-8a52b3f3-eeb8-4fa0-b878-14da0c4f7df6 req-40d15a4e-25f2-4eae-af41-74f206b5785e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:52.562792 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-8a52b3f3-eeb8-4fa0-b878-14da0c4f7df6 req-40d15a4e-25f2-4eae-af41-74f206b5785e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:52.579069 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-8a52b3f3-eeb8-4fa0-b878-14da0c4f7df6 req-40d15a4e-25f2-4eae-af41-74f206b5785e service nova] Creating event network-changed:5d85a9de-2848-49e6-bde0-37a231102506 for instance a3da9bff-0b43-4aa3-acfd-fb44382d4999 on hv-cinder-83118 Feb 28 19:22:52.584053 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-8a52b3f3-eeb8-4fa0-b878-14da0c4f7df6 req-40d15a4e-25f2-4eae-af41-74f206b5785e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036173 Feb 28 19:22:52.584861 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 541/1083] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:22:52.632243 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-37b591b1-dd84-4d36-8ed4-deced0b76df0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Going to try to terminate instance {{(pid=101791) delete /opt/stack/nova/nova/compute/api.py:2562}} Feb 28 19:22:52.956739 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-37b591b1-dd84-4d36-8ed4-deced0b76df0 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "DELETE /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 204 len: 0 microversion: 2.1 time: 0.413248 Feb 28 19:22:52.957517 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 543/1084] 10.222.0.21 () {58 vars in 1238 bytes} [Mon Feb 28 19:22:52 2022] DELETE /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 28 19:22:52.967254 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-5ce9c75e-8968-4554-9bdd-9ec870d809d8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:22:52.968246 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-5ce9c75e-8968-4554-9bdd-9ec870d809d8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:22:52.976387 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5ce9c75e-8968-4554-9bdd-9ec870d809d8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:52.976926 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5ce9c75e-8968-4554-9bdd-9ec870d809d8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:52.977824 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5ce9c75e-8968-4554-9bdd-9ec870d809d8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:52.978295 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-5ce9c75e-8968-4554-9bdd-9ec870d809d8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:53.509018 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.policy [None req-5ce9c75e-8968-4554-9bdd-9ec870d809d8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101792) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:22:53.518639 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-5ce9c75e-8968-4554-9bdd-9ec870d809d8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1569 microversion: 2.1 time: 0.556149 Feb 28 19:22:53.519227 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 542/1085] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:22:52 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1569 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:22:54.537290 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-5ef88995-11ca-4ec2-88c5-9c1cf3c0ac28 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:22:54.537982 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-5ef88995-11ca-4ec2-88c5-9c1cf3c0ac28 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:22:54.546162 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5ef88995-11ca-4ec2-88c5-9c1cf3c0ac28 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:54.546599 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5ef88995-11ca-4ec2-88c5-9c1cf3c0ac28 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:54.547385 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5ef88995-11ca-4ec2-88c5-9c1cf3c0ac28 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:54.547813 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-5ef88995-11ca-4ec2-88c5-9c1cf3c0ac28 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:54.896222 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-5ef88995-11ca-4ec2-88c5-9c1cf3c0ac28 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:22:54.904944 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-5ef88995-11ca-4ec2-88c5-9c1cf3c0ac28 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1450 microversion: 2.1 time: 0.371709 Feb 28 19:22:54.905518 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 544/1086] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:22:54 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1450 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:22:55.670395 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [req-f4d03b80-da7b-4e8e-9ef7-e17fc56c0944 req-ab69e7de-7da0-4baf-a244-b92eae24b40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3da9bff-0b43-4aa3-acfd-fb44382d4999", "name": "network-vif-deleted", "tag": "5d85a9de-2848-49e6-bde0-37a231102506"}]} {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 28 19:22:55.671915 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 19:22:55.671915 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: warnings.warn(msg) Feb 28 19:22:55.680056 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-f4d03b80-da7b-4e8e-9ef7-e17fc56c0944 req-ab69e7de-7da0-4baf-a244-b92eae24b40e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:55.680495 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [req-f4d03b80-da7b-4e8e-9ef7-e17fc56c0944 req-ab69e7de-7da0-4baf-a244-b92eae24b40e service nova] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:55.696608 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.compute.server_external_events [req-f4d03b80-da7b-4e8e-9ef7-e17fc56c0944 req-ab69e7de-7da0-4baf-a244-b92eae24b40e service nova] Creating event network-vif-deleted:5d85a9de-2848-49e6-bde0-37a231102506 for instance a3da9bff-0b43-4aa3-acfd-fb44382d4999 on hv-cinder-83118 Feb 28 19:22:55.701746 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [req-f4d03b80-da7b-4e8e-9ef7-e17fc56c0944 req-ab69e7de-7da0-4baf-a244-b92eae24b40e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035464 Feb 28 19:22:55.702331 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 543/1087] 10.222.0.21 () {64 vars in 1317 bytes} [Mon Feb 28 19:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 28 19:22:55.924569 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-239e6e72-9360-47ef-a6d6-54615586cb6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:22:55.927041 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.compute.api [None req-239e6e72-9360-47ef-a6d6-54615586cb6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101791) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:22:55.944690 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-239e6e72-9360-47ef-a6d6-54615586cb6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:55.947037 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-239e6e72-9360-47ef-a6d6-54615586cb6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:55.947939 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-239e6e72-9360-47ef-a6d6-54615586cb6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:55.948388 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG oslo_concurrency.lockutils [None req-239e6e72-9360-47ef-a6d6-54615586cb6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:56.182120 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.policy [None req-239e6e72-9360-47ef-a6d6-54615586cb6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75426eab49c4b579411c05048f16184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71617ef8c9904a419b7928654b614f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101791) authorize /opt/stack/nova/nova/policy.py:199}} Feb 28 19:22:56.190346 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-239e6e72-9360-47ef-a6d6-54615586cb6a tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 200 len: 1219 microversion: 2.1 time: 0.269576 Feb 28 19:22:56.190894 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 545/1088] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:22:55 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 1219 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 28 19:22:57.208292 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6d72fa1f-33c9-43f3-8862-cb34369e59c8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '>' {{(pid=101792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:22:57.209017 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.compute.api [None req-6d72fa1f-33c9-43f3-8862-cb34369e59c8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] [instance: a3da9bff-0b43-4aa3-acfd-fb44382d4999] Fetching instance by UUID {{(pid=101792) get /opt/stack/nova/nova/compute/api.py:2813}} Feb 28 19:22:57.216717 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d72fa1f-33c9-43f3-8862-cb34369e59c8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:57.217158 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d72fa1f-33c9-43f3-8862-cb34369e59c8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:57.217916 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d72fa1f-33c9-43f3-8862-cb34369e59c8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Feb 28 19:22:57.218345 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG oslo_concurrency.lockutils [None req-6d72fa1f-33c9-43f3-8862-cb34369e59c8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Lock "e343478d-eb46-4c0e-957d-8f9025dbea36" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Feb 28 19:22:57.269635 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.wsgi [None req-6d72fa1f-33c9-43f3-8862-cb34369e59c8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] HTTP exception thrown: Instance a3da9bff-0b43-4aa3-acfd-fb44382d4999 could not be found. Feb 28 19:22:57.270245 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: DEBUG nova.api.openstack.wsgi [None req-6d72fa1f-33c9-43f3-8862-cb34369e59c8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Returning 404 to user: Instance a3da9bff-0b43-4aa3-acfd-fb44382d4999 could not be found. {{(pid=101792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Feb 28 19:22:57.271098 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO nova.api.openstack.requestlog [None req-6d72fa1f-33c9-43f3-8862-cb34369e59c8 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999" status: 404 len: 111 microversion: 2.1 time: 0.067272 Feb 28 19:22:57.271667 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: [pid: 101792|app: 0|req: 544/1089] 10.222.0.21 () {58 vars in 1235 bytes} [Mon Feb 28 19:22:57 2022] GET /compute/v2.1/servers/a3da9bff-0b43-4aa3-acfd-fb44382d4999 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 28 19:22:57.617261 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: DEBUG nova.api.openstack.wsgi [None req-4bdec014-1641-48fe-a4c4-7550989b1e10 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] Calling method '.version_select at 0x7f912f6dd940>' {{(pid=101791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 28 19:22:57.691952 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO nova.api.openstack.requestlog [None req-4bdec014-1641-48fe-a4c4-7550989b1e10 tempest-TestShelveInstance-1776955866 tempest-TestShelveInstance-1776955866-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1156493615" status: 202 len: 0 microversion: 2.1 time: 0.077937 Feb 28 19:22:57.691952 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: [pid: 101791|app: 0|req: 546/1090] 10.222.0.21 () {58 vars in 1253 bytes} [Mon Feb 28 19:22:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1156493615 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 28 19:23:18.650038 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:23:18.650732 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: Mon Feb 28 19:23:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:23:40.916509 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:23:40.917336 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: Mon Feb 28 19:23:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:25:02.666054 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:25:02.666783 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: Mon Feb 28 19:25:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:25:19.522590 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:25:19.523231 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: Mon Feb 28 19:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:25:23.020308 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:25:23.020930 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: Mon Feb 28 19:25:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:26:38.658061 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:26:38.658862 dv-cinder-831187-1-iscsi devstack@n-api.service[101791]: Mon Feb 28 19:26:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:27:00.926722 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:27:00.927436 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: Mon Feb 28 19:27:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 28 19:28:22.674978 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 28 19:28:22.675723 dv-cinder-831187-1-iscsi devstack@n-api.service[101792]: Mon Feb 28 19:28:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!